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This  study  develops  the  rank  deficient  adjustaent  theory  in  a  geometrical  manner. 
In  accordance  with  most  least -squares  (L.S.)  applications,  the  adjustaent  Model  Is 
considered  linear  or  linearized.  The  fundaaental  building  blocks  consist  of 
orthonoraal  vectors  spanning  the  spaces  and  surfaces  linked  to  the  L.S.  setup.  Froa 
this  setup  to  the  desired  results  including  the  variance- covariance  Matrices,  the 
standard  adjustaent  quantities  can  be  represented  by  first-  and  second  order 
tensors.  It  is  thus  possible  to  express  them  in  terms  of  the  coaponents  of  the 
above  vectors,  allowing  for  an  easy  and  clearcut  geometrical  interpretation  of  the 
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L.S.  process.  By  virtue  of  such  a  "vectorlzation” ,  the  propagation  of  the 
contravar iant  and  oovariant  metric  tensors  is  shown  to  fit  perfectly  the  variance 
covariance  propagation  law  and  even  to  establish  a  weight  propagation  law.  The 
opportunity  to  obtain  variance -covariances  and  weights  as  a  coherent  part  of  the 
geometrical  development  provides  the  motivation  for  using  tensor  structure  in  the 
analysis  of  various  L.S.  methods  and  their  properties. 

In  principle,  an  isomorphism  between  adjustments  and  geometry  is  rooted  in  the 
notion  that  a  consistent  model  relationship  restricts  a  general  vector  to  a  "model 
surface"  (here  a  hyperplane).  The  mechanism  is  provided  by  the  L.S.  criterion, 
which  projects  an  "observational  vector"  dx  lying  in  an  n-dimensional  observational 
space  orthogonally  onto  this  u'  dimensional  model  surface.  The  projected  vector  is 
attributed  the  dual  notation  dx'=du'.  The  observational  space  is  spanned  by  n 

orthonormal  vectors  £,  j .  u,  ...  ,  while  the  model  surface  embedded  in  it  is 

spanned  by  u'  orthonormal  vectors  £,  j,  ...  In  the  rank-deficient  problems,  where 
the  rank  of  the  design  matrix  is  u'  and  the  rank  deficit  is  u"=u  u',  the  model 
surface  Is  also  embedded  in  a  u-dimensional  parametric  space  spanned  by  u 

orthonormal  vectors  £.  J .  t,  ...  .  and  is  thus  an  intersection  of  the 

observational  and  the  parametric  spaces.  The  observational  space  contravar iant 
components  of  dx'  represent  the  adjusted  observations,  and  the  parametric-space 
cont ravar iant  components  of  du 1  represent  the  adjusted  parameters.  These  two  kinds 
of  components  of  the  same  geometrical  object  are  related  through  the  design  matrix. 

The  isomorphic  geometrical  setup  reveals  that  all  the  adjustment  matrices,  i.e., 
the  design  matrix,  the  variance-covariance  matrices  (of  observations,  adjusted 
observations,  residuals,  and  parameters),  end  the  corresponding  weight  matrices, 
can  be  expressed  as  a  product  of  two  constituent  matrices  each.  This  outcome  is 
further  qualified:  (a)  All  constituent  matrices  are  formed  in  terms  of  orthonormal 
vectors,  the  elementary  geometrical  objects;  (b)  These  vectors  are  the  same  in 
either  matrix  of  the  constituent  pair,  only  the  type  of  their  components  may 
differ;  and  (c)  The  set  t,  J,  ...  spanning  the  model  surface  is  common  to  all 
constituent  matrices  except  those  pertaining  to  the  residuals. 

The  geometrical  development  yields  a  general  L.S.  resolution,  where  the  solution 
vector  du '  and  its  variance  covariance  matrix  a'  are  non  unique.  This  resolution 
is  analyzed  in  three  distinct  formulations  giving  identical  results.  Two  of  these 
formulations  utilize  t hr-  matrix  of  minimal  constraints,  the  first  generating 
augmented  observation  equations  and  the  second  generating  augmented  normal 
equations.  The  third  formulation  analyzes  the  parametric  space  components  of  the 
orthonormal  vectors,  showing  that  the  properties  of  the  resolution  depend  entirely 
on  n"*u'  free  elements  grouped  in  the  matrix  AL" .  A  completely  arbitrary  AL” 
produces  the  general  resolution  with  non  unique  du '  and  a'.  A  specific  data 
dependent  restriction  on  AI."  yields  the  unique  minimum  norm  solution  du'.  but  a 
non  unique  a’  finally,  If  AI,"  0,  both  du '  and  a'  are  unique.  In  this  case  du ' 
is  the  minimum  norm  solution  as  above  and  a'  is  Its  variance  covariance  matrix  with 
the  minimum  trace.  It  can  be  concluded  that  the  minimum  trace  criterion  is 
superior  to  any  other  Kven  if  some  of  them  produced  unique  du'  and  a',  the  norm 
of  tin'  would  not  be  a  minimum,  or  the  trace  of  a'  would  not  be  a  minimum,  or  both 

other  topics  related  to  geometry  with  tensor  structure  are  addressed  as  well 
An  algorithm  furnishing  the  pseudo  1 nverse  of  a  positive  semi  definite  matrix,  which 
could  Oi-  useful  for  its  straightforward  geometrical  Interpretation  as  well  as  for 
its  computational  efficiency.  Is  developed  as  a  by  product  of  this  analysis  The 
Choleski  algorithm  for  positive  definite  as  well  as  positive  semi  definite  matrices 
is  interpreted  in  terms  of  orthonormal  vector  component s. N  Another  item  shows  how 
the  tensor  structure  developed  herein  could  be  useful  1 n  Ippl i ca t 1 ons  unrelated  to 
adjustment  calculus,  such  as  the  transformation  of  multiple  integrals. 
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1.  INTRODUCTION 


This  study  represents  a  continuation  of  efforts  aimed  at  developing  the 
least  squares  theory  and  results  in  a  purely  geometrical  manner.  It  is  based  on 
[Blaha,  1984],  abbreviated  here  as  [B].  One  of  the  important  limitations  listed 
in  this  reference  is  the  full  column  rank  of  the  design  matrix  of  the  parametric 
adjustment.  As  its  title  suggests,  the  present  analysis  is  intended  to  extend 
the  scope  of  [B]  by  bridging  this  limitation.  Undoubtedly,  most  or  all  of  the 
others  can  similarly  be  bridged,  one  by  one. 

In  both  [B]  and  the  present  study,  the  various  finite-dimensional  spaces 
are  Rlemannian,  where  the  metric  {or  line  element)  is  expressible  by  means  of  a 
symmetric  covariant  tensor  of  second  order.  These  spaces  are  considered  only 
within  an  infinitesimal  neighborhood  of  the  point  called  P,  contained  by  all  of 
them  and  corresponding  to  the  point  of  Taylor  expansion  in  the  parent  least- 
squares  (L.S.)  problem.  In  accordance  with  most  adjustment  applications,  where 
all  except  the  first  (linear)  terms  in  the  expansion  are  ignored,  the  expanded 
L.S.  problem  as  treated  here  is  linear,  whether  its  original  version  was  linear 
or  not.  The  same  statement  applies,  of  course,  also  to  [B],  which  expressly 
avoided  nonlinear  adjustment.  The  above  spaces  can  thus  be  regarded  as 
Eucledian  (or  flat),  which,  by  definition,  can  be  described  over  a  finite  region 
in  Cartesian  coordinates. 

In  view  of  the  foregoing,  the  term  "surface"  used  in  [B]  means  actually 
"hyperplane",  since  it  is  not  limited  to  two  dimensions  and  since  it  is 
intrinsically  a  flat  space.  However,  references  to  surface  will  be  retained  for 
convenience,  allowing  for  an  easy  transfer  of  familiar  terminology,  e.g.  from 
[Hotlne.  1969],  concerned  with  two  dimensional  surfaces  embedded  in  a  three- 
dimensional  space.  This  terminology  should  present  no  confusion  since  we  know 
that  such  surfaces  will  not  be  two  dimensional  in  general;  as  a  special  case, 
the  model  "surface"  could  even  be  one  dimensional,  reducing  here  to  a  straight 
line  through  P,  of  which  only  a  small  segment  in  the  neighborhood  of  P  would  be 
of  interest. 

From  the  philosophical  standpoint,  the  geometrical  analysis  of  the  rank 
deficient  parametric  adjustment  typifies  the  notion  that  could  be  dubbed  an 
"orthonormalization  of  the  least  squares  universe".  In  this  sense,  the 
fundamental  building  blocks  consist  of  orthonormal  vectors  emanating  from  the 


point  P.  These  vectors  are  considered  as  fixed  entities,  and  their  subsets  span 
the  spaces  and  surfaces  linked  to  the  L.S.  setup.  Their  components  are 
separated  into  contravariant  (denoted  by  an  upper  index)  and  covariant  (denoted 
by  a  lower  index)  in  accordance  with  the  principles  of  tensor  analysis,  and  are 
regarded  as  point  functions  at  P. 

From  the  L.S.  setup  to  the  desired  results  including  the  variance- 
covariance  and  the  weight  matrices,  the  standard  adjustment  quantities  can  be 
represented  by  first-  and  second-order  tensors.  It  is  thus  possible  to  express 
them  in  terms  of  the  components  of  the  above  orthonormal  vectors,  which  is 
indeed  the  main  feature  of  both  the  previous  and  the  current  studies.  This 
procedure,  called  in  [B]  "vector ization"  of  tensors,  allows  for  an  easy  and 
clearcut  geometrical  interpretation  of  the  L.S.  process.  As  a  by-product,  it 
circumvents  the  need  to  verify,  at  various  stages  of  the  development,  whether 
certain  "objects"  are  tensors  or  not,  which  under  different  circumstances  would 
be  done  by  checking  whether  the  tensor  transformation  law  applies. 

The  vectorization  of  the  metric  tensor  (in  mathematical  literature  also 
called  the  covariant  metric  tensor  or  the  fundamental  metric  tensor)  and  the 
associated  metric  tensor  (also  called  the  contravariant  metric  tensor  or  the 
conjugate  metric  tensor)  is  especially  relevant  in  view  of  a  complete  treatment 
of  adjustment  problems.  By  virtue  of  the  vectorization,  the  "propagation"  of 
these  tensors  was  shown  in  [8]  to  fit  perfectly  the  variance-covariance 
propagation  law  and  even  to  establish  a  weight  propagation  law.  This  indicates 
that  the  vectorization  is  a  tool  whose  potential  is  readily  exploited  in  the 
tcnsorial  environment.  Without  the  use  of  tensor  structure,  with  its 
contravariant  and  covariant  versions  of  the  metric  tensor,  the  side-by-side 
derivation  of  these  propagation  laws  would  have  been  more  difficult  if  not 
impossible.  The  opportunity  to  obtain  the  propagated  variance-covariances  and 
weights  as  a  coherent  part  of  the  geometrical  development  constitutes  a  strong 
motivation  for  using  tensor  structure  in  the  description,  treatment,  and 
analysis  of  various  L.S.  methods  and  their  properties. 


2.  GEOMETRICAL  SETUP 


In  pursuing  the  avenue  of  relating,  for  example,  associated  metric  tensors 
to  variance- covariance  matrices,  one  soon  encounters  rank-deficient  symmetric 
contravar iant  tensors  which  behave  as  the  "regular"  associated  metric  tensors  at 
P,  but  only  when  applied  to  tensors  restricted  to  a  given  surface  embedded  in 
some  original  space.  In  other  words,  they  can  be  regarded  as  associated  metric 
tensors  in  spaces  of  lower  dimensions  than  the  original  space,  but  expressed  in 
the  full  dimensional  for*  of  the  original  space.  They  could  be  called 
"restrictive  associated  metric  tensors",  "defective  associated  metric  tensors", 
etc.  However,  for  the  reason  explained  below  they  will  be  called  "necessary 
associated  metric  tensors".  A  similar  description  applies  also  when  relating 
metric  tensors  to  weight  matrices.  In  this  case,  the  pertinent  rank-deficient 
covariant  tensors  will  be  called  "necessary  metric  tensors". 


Suppose  that  an  (original)  n-diaensional  space  is  spanned  by  n  orthonormal 
vectors  denoted  as  i,  j,  ...  ,  v,  ...  belonging  to  the  point  P,  and  that  a 
u' -dimensional  surface  of  interest  embedded  in  this  space  is  spanned  by  u'  of 
these  vectors,  namely  8,  J,  ...  The  associated  metric  tensor  is  then  given  as 


.r  „s  ,r  .s 
=  88  +  j  J  ♦ 


r  b 

*■  V  V 


while  the  necessary  associated  metric  tensor  is 


, rs  „r „s  .r  ,s 
g'  =  8  8  +  j  j  + 


where  the  indices  r  and  s,  identifying  the  space  components,  range  between  1  and 

n.  Both  of  these  tensors  raise  the  index  of  dx '  representing  the  covariant 

s 

components  of  an  arbitrary  vector  dx ’  lying  in  the  surface.  However,  the  use  of 
gr3  is  sufficient,  but  not  necessary.  The  tensor  of  the  lowest  rank  that  can 
accomplish  this  Is  g'  ,  both  necessary  and  sufficient,  hence  the  attribute 
"necessary" . 


In  the  present  context,  the  n  dimensional  space  spanned  by  8 ,  j,  ...  , 
u ,  ...  is  called  "observational  space",  the  u'  dimensional  surface  spanned  by  8, 
j,  ...  is  called  "model  surface",  and  a  further  n"  dimensional  surface  spanned 
by  u,  ...  is  called  "error  surface".  The  error  surface  is  an  orthocomplement  of 


3 


the  model  surface  In  the  observational  space  (all  considered  at  P) .  The 
necessary  associated  metric  tensor  for  the  error  surface  is  written  as 


so  that 


„rs  r  s 
g  =i/v  +  .  .  .  . 


rs  .  rs  „rs 
g  =  S'  +  g • 


This  relationship  indicates  a  close  analogy  to 


dxr  =  dx ' r  +  dx"r, 


where  the  vector  dx  in  the  observational  space  is  decomposed  into  two  orthogonal 
vectors,  dx'  lying  in  the  model  surface  and  dx"  lying  in  the  error  surface.  The 
lengths  (tensor  invariants)  of  these  three  vectors  are  respectively  ds,  ds',  and 
ds".  All  of  the  above  tensor  equations  could,  of  course,  be  written  with  lower 
indices  instead,  in  which  case  the  term  "associated"  would  be  dropped. 

Similar  to  [B],  the  set  of  contravariant  components  dx  is  considered  to 

represent  observations  in  an  adjustment  model  after  linearization.  It  is 
r  r 

decomposed  into  dx^  and  dx^,  w**ere  the  first  set  belongs  to  a  vector 
dx^j  lying  in  the  model  surface  and  the  second  set  completes  the  system  of 
equations  dxr=dx^ j+dx j .  (The  restriction  of  dx ^ 1 ^  to  the  model  surface 


can  be  thought  of  as  the  geometrical  equivalent  of  a  consistent  model 
relationship  between  the  observables  and  the  parameters.)  In  general,  there 

exists  an  infinite  number  of  solutions  for  dx.^..  However,  if  the  quadratic 

s  r  *  " 

form  dx.  .g  dx,_.,  i.e.,  the  square  of  the  length  of  the  vector  dx.  . , 

(s)  sr  (c)  (2) 

should  be  a  minimum,  dx^  must  be  orthogonal  to  the  model  surface  and  lies, 
therefore,  in  the  error  surface.  Consequently,  the  vectors  dx^j  and  dx(2) 
become  unique,  such  that  dx^sdx'  and  dx^2jsdx''-  Furthermore,  the  quadratic 


dx"sg  dx"r 
sr 


minimum 


depicts  the  standard  L.S.  criterion  written  in  adjustment  notations  as 
T  T 

V  PV-  £  PS=minimum,  where  S  represents  the  residuals  (corresponding  here 

r 

to  dx"  )  and  P,  not  to  be  confused  with  the  point  P,  is  the  weight  matrix  of 

observations  (corresponding  to  g  ).  The  latter  is  defined  as  P=C  where  C  is 

8  r 

rs 

a  given  variance-covariance  matrix  of  observations  (corresponding  to  g  ). 
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In  expanding  the  present  terminology,  dx  is  called  "observational  vector", 
dx'  is  called  "model  vector",  and  dx"  is  called  "error  vector",  dx'  oeing  an 
orthogonal  projection  of  dx  on  the  model  surface  and  dx"  being  an  orthogonal 
projection  of  dx  on  the  error  surface.  The  L.S.  criterion  is  thus  seen  in  the 
geometrical  context  as  minimizing  the  length  of  the  error  vector  in  the 
observational  space  metricized  by  the  weight  matrix  of  observations.  The 
foregoing  discussion  is  general,  applicable  to  the  full-rank  and  the  rank- 
deficient  adjustments  alike.  The  next  section  highlights  the  geometrical 
distinction  between  the  two  kinds  of  adjustments. 


2 . 2  Universal  Space  and  Its  Partition 

The  vectors  dx,  dx',  and  dx"  as  Introduced  above  are  illustrated 
schematically  in  Fig.  1.  The  model  vector  dx'  is  also  denoted  as  du'  depending 
on  the  coordinate  system  used  to  express  its  components.  The  geometry  of  these 
vectors  resembles  that  of  Fig.  i  in  [B],  except  that  the  observational  space  in 
the  present  figure  is  two-dimensional,  n=2  (instead  of  three-dimensional),  and 
the  model  surface  is  one-dimensional,  u'=l  (instead  of  two-dimensional).  The 
error  surface,  in  [B]  called  "second  surface",  is  one-dimensional  in  both 
illustrations,  n"=3. 

In  considering  rank-deficient  adjustment  problems,  we  define  the  model 
surface  as  embedded  not  only  in  the  observational  space,  but  also  in  a  new, 
u-dimensional  "parametric  space".  Compared  to  its  full-rank  counterpart,  the 
dimensionality  of  this  geometrical  setup  is  increased  by  u",  where  u"  designates 
the  dimensions  of  a  new  subspace  called  "extension  surface".  The  latter  is  an 
orthocomplement  of  the  model  surface  in  the  parametric  space,  and  is  defined  to 
be  orthogonal  to  the  observational  space.  Accordingly,  the  complete  geometrical 
configuration  must  be  presented  In  an  all-encompassing  N- dimensional  "universal 
space",  where  N=n+u"=n"+u,  with  u=u'+u".  In  the  illustration  of  Fig.  1,  the 
dimensions  not  listed  above  are  u"=l.  u*2,  and  N=3. 

If  the  extension  surface  were  absent,  i.e.,  if  u"=0,  the  situation  of 
Fig.  1  would  correspond  to  a  full-rank  L.S.  setup.  The  universal  space  would  be 
identical  to  the  observational  space  and  the  parametric  space  would  be  identical 
to  the  model  surface,  hence  N=n  and  u=u’.  The  model  vector  du'  lying  in  the  u'- 
dimenslonal  model  surface  would  then  be  expressed  in  model -surface  coordinates, 

5 


yj. 


Fig.  1 

Symbolic  representation,  in  the  N-dimensional  universal  space  (here  N  =  3), 
of  tne  observational  vector  dx  and  other  related  vectors  in  the  geometrical  setup 
corresponding  to  the  rank-deficient  parametric  adjustment 
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i.e..  it  would  have  u'  components  of  either  kind  (contravariant  and  covariant). 
On  the  other  hand,  the  rank-deficient  L.S.  setup  corresponds  to  u">0  and  thus 
u>u',  the  model  surface  being  a  subspace  of  the  parametric  space  as  stated  in 
the  preceding  paragraph.  In  the  geometrical  representation,  the  rank-deficient 
L.S.  setup  is  distinguished  from  its  full-rank  counterpart  by  the  fact  that  the 
model  vector  du'  lying  in  the  u 1 -dimensional  model  surface  is  expressed  in 
parametric-space  coordinates  rather  than  in  model-surface  coordinates,  i.e.,  it 
has  u>u'  components  of  either  kind. 


The  universal-space  configuration  corresponding  to  the  rank-deficient  L.S. 
setup  is  elucidated  via  orthonormal  vectors  emanating  from  P.  In  particular, 

the  universal  space  is  spanned  by  N  orthonormal  vectors  v . 8,  J . t, 

...  ,  giving  rise  to  its  partition  as  follows: 


n"  f  u'  =  n  -dimensional  u'  +  u"  =  u  -dimensional 

observational  space  parametric  space 


»••••# 

!  e  ,  j  .  .  .  . 

i 

it,... 

i 

(4) 

n"  -dimensional 

\ 

1  u'  -dimensional 

| 

;  u”  -dimensional 

error  surface 

l  model  surface 

1  extension  surface 

The  error  surface  is  confirmed  to  be  an  orthocomplement  of  the  model  surface  in 
the  observational  space,  while  the  extension  surface,  spanned  by  the  u" 

orthonormal  vectors  t .  is  confirmed  to  be  an  orthocomplement  of  the  model 

surface  in  the  parametric  space.  The  extension  surface  could  further  be  viewed 
as  an  orthocomplement  of  the  observational  space  in  the  universal  space,  etc. 
Moreover,  the  model  surface  is  seen  to  be  an  intersection  of  the  observational 
and  the  parametric  spaces. 


The  partition  of  the  universal  space  in  (4)  indicates  that  more  than  one 
coordinate  system  may  become  involved  at  various  stages  of  the  development.  In 
addition  to  a  coordinate  system  associated  with  the  universal  space  itself,  each 
of  the  following  spaces  and  surfaces  are  endowed  with  a  coordinate  system 
symbolized  by  braces: 


*.y. -\y.y.y 


observational  space  . . . 

...  <xr>. 

r=l ,2, . . 

.  ,n; 

(5a) 

parametric  space  . 

...  <u“>. 

a=l , 2 ,  .  . 

.  ,u; 

(5b) 

model  surface  . 

. ..  {uL}, 

L=1 , 2 , . . 

.  ,u'  ; 

(5c) 

extension  surface  . . . .  , 

.  • •  {wA}, 

A=1 ,2, . . 

.  ,u" . 

(5d) 

The  systems  (5a,b,d)  will  serve  In  the  next  chapter  to  resolve  the  rank- 
deficient  L.S.  setup.  The  systems  (5c, d)  will  be  used  In  the  next  section  as  a 
stepping  stone  toward  expressing  a  "rank-deficient  design  tensor"  in  terms  of 
partial  derivatives.  According  to  an  earlier  statement,  the  full-rank  L.S. 
setup  would  be  characterized  by  an  identity  between  the  systems  (5b)  and  (5c), 
and  by  the  absence  of  the  system  (5d). 

We  now  present,  in  Table  1,  tensor  quantities  expressed  In  the  coordinate 
systems  (5a,b,d).  They  include  first-  and  second-order  contravariant  tensors, 
and  second  order  mixed  tensors,  all  representing  point  functions  at  P.  One  can 
imagine  first  and  second  order  covariant  tensors  added  to  the  table  following 
the  pattern  of  its  first  two  parts  with  all  the  indices  lowered.  Great  many 
tensor  relations  can  be  derived  with  the  aid  of  this  table,  such  as  equations 
(1)  and  (2)  which  can  be  read  directly,  or  more  complex  expressions  which  can  be 
formed  through  tensor  contractions.  Thus,  Table  1  will  be  relevant  in  much  of 
the  geometrical  development  in  this  study. 

The  arrangement  of  spaces  and  surfaces  in  Table  1  conforms  to  their 
representation  in  (4).  Due  to  the  vectorized  formulation  of  all  the  tensors, 
the  latter  are  automatically  classified  in  two  respects,  namely,  according  to 
the  space  or  surface  in  which  they  exist  as  geometrical  objects,  and  according 
to  the  coordinate  system  used  to  express  their  individual  components.  In 
considering  the  first  classification,  one  can  write  the  identity  dx'sdu',  for 
example,  stating  that  the  vectors  dx '  and  du'  are  one  and  the  same  geometrical 
object,  represented  by  "a"  units  along  the  vector  i,  "b"  units  along  the  vector 
j,  etc.  With  regard  to  the  second  classification,  the  component  sets  dx'1  and 
du'a  are  given  a  fundamentally  different  adjustment  interpretation  from  one 
another.  With  both  sets  referring  to  a  linearized  model,  the  former  represents 
the  adjusted  observations  and  the  latter  represents  the  adjusted  parameters. 
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observational  space 


parametric  space 


error  surface 


model  surface 


extension  surface 


.  r  .  .  r 

+  a  £  +  b  j  + 


„  r  .  .r 
a  £  +  b  j  + 


a  £a  +  b  ja  + 


+  z  t  + 


„  a  .  .a 
a  £  +  b  j  + 


If 

& 


4  « 

z  t  + 


4A 

z  t  + 


r  s 

V  V  + 


„r.s  .r.s 
+  £  £  +  J  j  + 


,.rs  = 


-.r.s  .r.s 
£  £  +  J  J  + 


'ft 

i 

8 


.,rs  r  s 
g  =  v  v  + 


.a.&  .a. 1 5 

*  *  +  j  J  + 

.a.f}  .a  .8 

£  £  +  j  JM  + 


a  8 

i  t  tp  + 


tV  + 


t\°  + 


r  r 

*  e«  +  J  J«  + 

«%  *  JaJr  + 


* 


t  t  + 
a 


Table  1 

First-  and  second-order  tensors  in  the  partitioned  universal  space 


2 . 3  Rank-Deficient  Design  Tensor 


r 

In  this  section,  the  tensor  A  of  Table  1,  called  the  rank  deficient 

a 

design  tensor,  will  be  developed  in  terms  of  partial  derivatives.  This  tensor 
will  thus  be  shown  as  structurally  similar  to  its  counterpart  in  [B],  which 
reflected  the  actual  formation  of  the  design  matrix  in  the  full-rank  context. 
Indeed,  the  design  matrix  is  constructed,  in  adjustment  calculus,  through  first- 
order  partial  derivatives  of  the  observables  with  respect  to  the  parameters 
whether  it  is  full-rank  or  rank-deficient.  Showing  that  the  design  tensor 
follows  the  same  pattern  further  supports  the  analogy  between  the  adjustment 
theory  and  geometry.  Moreover,  this  knowledge  paves  the  way  for  the  treatment 
of  nonlinear  (and  non-1 inear ized)  adjustment  models  containing  higher-order 
derivatives  of  the  observables  with  respect  to  the  parameters. 

The  initial  step  in  the  current  development  makes  use  of  the  coordinate 
systems  (5c, d).  Merged  together,  these  systems  serve  to  define  an  interim 
(overbarred)  coordinate  system  for  the  parametric  space,  {ua}  =  {u*\wA} ,  An 
important  property  of  such  an  arrangement  is  that  the  interim  system  is  normal, 
in  the  sense  that  the  last  u"  components,  contravarlant  and  covariant,  of 
vectors  lying  in  the  model  surface  are  zero,  as  are  the  first  u'  components  of 
vectors  lying  in  the  extension  surface.  It  is  thus  a  higher  dimensional 
analogue  of  the  normal  coordinate  systems  in  three  dimensions  as  described  in 
Chapter  15  of  [Hotine,  1969]. 

The  above  generalized  statement  will  now  be  proved  in  detail.  In  analogy 
to  the  N  surfaces  of  {Hotine,  1969],  where  any  such  (two  dimensional)  surface  is 
characterized  by  a  constant  value  of  the  third  spatial  coordinate  (N), 
a  u'  dimensional  surface  embedded  in  a  u  dimensional  space,  where  u=u'*u",  Is 
now  characterized  by  u"  constant  coordinates.  In  particular,  the  u-dimensional 
space  is  the  parametric  space,  the  u”  coordinates  held  constant  are  w  ,  and  the 
u'  dimensional  surface  is  the  model  surface  with  the  (variable)  coordinates  u^ . 
Since  the  latter  are  also  the  first  u'  of  the  space  coordinates  ua,  any 
displacement  vector  ( du ' )  on  the  surface  expressed  by  the  surface  contravarlant 
components  du'*'  has  du'*'  also  as  the  first  u’  space  contravarlant  components, 
the  last  u"  such  components  being  zero.  This  relationship  is  symbolized  by 
du  ’  a-- (du  ’  *\  0) .  Applied  to  the  orthonormal  vectors  C,  j . it  yields 

e®  -  (« L, 0)  .  j“  -  ( jL, 0)  ,  ...  (6a) 


J\.V„ Vl  JC:  A.V.  > 


Since  tjia=0,  taJa=0-  •••  represent  a  nonsingular  system  of  u' 

equations,  the  u‘  unknowns  t^.  L=4,2 . u'  are  unique,  all  equal  to  zero. 

This  is  true  for  all  u"  orthonormal  vectors  t,  ...  spanning  the  extension 
surface.  However,  little  could  be  said  about  the  covariant  components  8^, 

J  ,  ...  if  the  last  u"  space  coordinates  were  not  at  the  same  time  the 
extension  surface  coordinates.  But  since  w  have  this  property  by  construction, 
in  analogy  to  the  preceding  paragraph  we  first  deduce  that 

t®  =  (0  ,  tA) .  (6b) 

where  the  extension -surface  contravariant  components  of  the  vectors  t,  ...  are 
also  their  last  u"  space  contravariant  components.  Now  8ata=0,  ... 
represent  a  nonsingular  system  of  u”  equations,  whereby  the  u"  unknowns  8^, 

A=l,2 . u”  are  unique,  all  equal  to  zero.  This  is  true  for  all  u'  orthonormal 

vectors  8,  j,  ...  spanning  the  model  surface. 

We  next  contract  the  partially  known  8  with  8a,  Ja,  ...  from  (6a) 

OL 

and  obtain  a  nonsingular  system  of  u'  equations  in  u'  unknowns  8  , 

Lj 

L=l,2 . u'.  However,  in  considering  the  model  surface,  the  same  equations 

hold  true  also  without  the  overbar.  Since  this  argument  again  applies  to  all  of 
8  ,  j . it  follows  that 

«  =>(8  ,0),  j  =  (J.  .  0) .  (7a) 

a  L  a  L 

where  8^,  J  ,  ...  represent  the  model -surface  components.  Finally,  upon 

contracting  the  partially  known  t  with  ta,  ...  from  (6b),  we  obtain  a 

a 

nonsingular  system  of  u"  equations  in  u”  unknowns,  eventually  resulting  in 

=  (0,  t.) .  (7b) 

a  A 

where  t  ,  ...  represent  the  extension  surface  components.  The  outcome  (6a)  (7b) 
is  possible  only  because  the  two  groups  of  coordinates  forming  the  interim 
system  are  surface  coordinates  in  their  own  right,  and  because  the  two  surfaces 
are  orthocomplements  of  each  other  in  the  underlying  parametric  space. 


To  complete  the  discussion  concerned  with  the  interim  coordinate  systen.,  we 
note  that  the  associated  metric  tensor  for  the  parametric  space  Is 


t* 


.a  -/9  ,0  7(9 

®  8  *■  j  j 


r  a  /S 

+  t  t  + 


1  1 


m  ‘f* w  ■ "  *  *  . 


'r&J 


or 


«0  .  I.M  .AO. 

g  -  (a  , k  )  . 


(8a) 


where  a*'^  and  kA^  are  the  associated  metric  tensors  for  the  model  surface  and 
for  the  extension  surface,  respectively.  This  follows  from  the  standard 
relations 

J.M  „L  .M  .1.  .M 
a  =£<  +  J  J 


AO 


tAt°  ♦ 


I 


ft 


The  symbolism  in  (8a)  indicates  that  in 


a^M  and  kA°  would  fora  the  diagonal  submatrices,  while  the 


generalized  fro*  two  to  any  dimensions 
■atrix  notations, 

off  diagonal  subaatrices  would  be  zero  as  one  of  the  basic  characteristics  of  a 
normal  syste*.  In  the  same  way,  but  with  all  the  indices  lowered,  the  metric 
tensor  for  the  parametric  space  can  be  written  as 


g 


3a 


“WW 


(8b) 


In  considering  that  the  model  surface  is  embedded  in  the  observational 

r 

space,  we  can  express  each  of  the  x  observational  space  coordinates  describing 
this  surface  as  some  function  of  the  model -surface  coordinates  uL,  namely 

r^  1 . 2 . n;  L - 1 ,2 . u  ’  . 


r  r  .  L . 
x  =  x  ( u  ) ; 


The  ordinary  rule  of  differentiation  for  this  system  of  equations  yields  the 

r 

following  linear  relations  between  the  observational  space  components  dx ’  and 
the  model  surface  components  du'1'  of  the  vector  dx'sdu'  lying  in  the  model 
surface . 


dx’r  -  (8xr/8uL)  dll’ L 


(9a) 


If  this  formula,  relating  the  space  and  the  surface  components  of  such  vectors, 
is  in  turn  applied  to  t,  j,  ..  .  it  follows  that 


r  I,  r 

Ax  /6u  s  A 

L 


„  r  „  ,  r  , 

ML  ’  J  JL 


(9b) 


where  use  has  been  made  of  Equations  (9a. b)  appear  in 

a  similar  fora  in  [B]  ,  and  represent  a  higher  dimensional  analogue  of  the 
formulas  found  in  [Hotine,  1969],  applicable  to  a  two  dimensional  surface 
embedded  in  a  three  dimensional  space 


i  ? 


v.’iVtVi* 


F  I« 

The  vectorized  formulation  of  dx  /3u  seen  above  is  based  on  the  fact  that 

the  Model  surface  (with  coordinates  uL)  is  embedded  in  the  observational  space 
r 

(with  coordinates  x  ),  On  the  other  hand,  the  extension  surface  (with 
coordinates  wA)  has  no  dimension  in  common  with  the  observational  space,  hence 
3xr/dw^0  When  Joined  together,  these  two  sets  of  partial  derivatives  yield 

(dxr /flu1'.  dxr/dwA)  *r(«1,0)  ♦  jr(JL,0)  «•  ... 

But  in  view  of  the  interim  systew,  the  left  hand  side  above  can  be  written  in  a 
r  <x 

compact  fora  as  dx  /3u  .  while  the  eoaponents  within  the  parentheses  on  the 

right  hand  side  are  t  .  j  .  by  (7a).  This  relation  can  thus  be 

a  a 

transcribed  in  tensor  notations  as 

dx‘  r)u°  «r  *  *  jP  J  ♦  .  .  .  (10) 

a  a 

That  (10)  is  a  tensor  equation  valid  In  conjunction  with  any  parametric- 
space  coordinates  ran  be  confirmed  through  the  transforaat ion  foraulas 

{  -  (au^/au01)  t  .  j  -  (au3/dua)j- . 

a  pa  p 

a 

where  the  coordinates  up  belong  to  the  general  systea  (5b)  These  relations  are 
substituted  in  (10).  the  latter  Is  contracted  by  dua/i)u7,  use  is  aade  of 
( 3  u° )  ( d  11°  3u7)  du^/3u7-<5^  and,  finally,  the  index  j  is  substituted 
for  by  a  The  result,  where  the  interia  systea  Is  no  longer  needed,  reads 

3xr  3Ua  Ar  er  i  •  jr  J  *  (11  ) 

a  a  a 

Equation  (11)  represents  the  coaplete  description  of  the  rank  deficient  design 
tensor,  whose  full  rank  counterpart  played  a  central  role  in  [ H 1  Although  this 
reference  displayed  the  full  rank  design  tensor  in  the  fora  (11),  In  the  present 
notations  it  would  he  properly  represented  by  (9t>)  In  considering  that  the 
aodel  surface  is  also  eabedded  in  (tie  parametric  space,  we  could  Introduce  a 
relation  siailar  to  (9b),  where  the  symbol  x  would  be  replaced  by  u  and  all  the 
indices  r  would  be  replaced  by  a  Equations  (9b)  and  (11)  together  with  this 
new  relation  would  t heri  confirm,  through  tensor  contractions,  the  validity  of 
the  chain  rule  3xr  3ul‘  (dxP.  ma  )  (  d u<*/du1' ) 

As  their  structure  reveals,  the  partial  derivatives  forming  the  design 

tensor  in  (11)  transform  the  cont ravar iant  components  of  vectors  lying  In  the 

a 

model  surface  from  the  parametric  spare  coordinate  system  (u  }  to  t  tie 

p 

observational  space  coordinate  system  (x  )  This  property,  fundamental  to  the 


S  *.  S  *.  s  s 


,1 


treatment  of  .1  rank  deficient  adjustment  model  via  an  isomorphic  geometrical 
setup,  is  utilize!  in  the  form 


dx'r  =  Aadu'a  •  (12) 

where  the  notations  du'  and  dx '  designate  the  same  vector  as  pointed  out 

earlier  This  equation  was  already  implied  by  Table  1,  where  the  design  tensor 

was  defined  in  anticipation  of  the  result  (11).  As  a  matter  of  interest,  we 

note  that  a  relation  similar  to  (12)  could  be  written  with  du  replacing  du', 

where  du  is  a  vector  from  the  parametric  space  such  that  dua=du ,a+du"a  as 

suggested  by  Table  1.  This  stems  from  the  fact  that  the  components  du"a  of  a 

r 

vector  lying  in  the  extension  surface  yield  zero  when  contracted  with  A^. 

r 

In  matrix  notations,  the  rank  deficient  design  tensor  A  is  written  as  A, 

a 

the  familiar  design  matrix  Following  the  conventions  of  (B)  for  second-order 
tensors,  the  first  and  tne  second  indices  refer  to  rows  and  columns, 

Is 

respectively,  in  the  case  of  a  mixed  tensor  such  as  A  ,  the  contravar iant 

a 

index  is  considered  as  its  first  and  the  covariant  index  as  its  second  By 
virtu*  of  (11).  tin  design  matrix  can  be  decomposed  into  a  product  of  two 
matrices  as  follows 


[flxr'dua)  ;■  A  =  F  L*^ 

(n*u)  (  nx  u  '  )  ( u  '  x  u ) 


(13a) 


where 


V  f  (  6  r  1  [  J  r  1 


t(*  JtJ  J 

a  a 


( 1 3b ,  c ) 


d  wh.re  [ J  ).  etc.,  represent  column  vectors  The  matrix  F  is  rectangular,  of 

T 

dimensions  (n*u'l  and  the  full  column  rank  u‘,  and  the  matrix  L*  is  rectangular 

of  dimensions  (  u  '  *  u  )  and  the  full  row  rank  u'.  In  the  case  of  (9b),  the  number 

of  columns  in  the  latter  matrix  would  reduce  to  u',  making  it  regular,  i  e  , 

square  and  nonsingular,  and  resulting  in  the  full  rank  design  matrix  particular 

T 

to  ( h  |  Although  both  F  and  !.*  considered  at  the  present  have  the  full  (column 
or  row)  rank  Individually,  their  product  in  (13a)  is  rank  deficient,  the  rank 
defir  leriry  being  u  11  u  The  design  matrix  A  of  dimensions  (n*u)  and  rank  u', 
where  n >0  characterizes  the  rank  deficient  parametric  adjustment  We  note 
that  if  n  u'.  the  model  surface  would  coincide  with  the  observat i ona 1  space  and 


S  adjustment  would  take  place 


d 


Similar  to  the  full -rank  case,  the  advantages  of  the  geometrical  approach 
to  the  analysis  of  the  rank-deficient  design  matrix  are  readily  apparent: 

1)  The  design  matrix  is  decomposed  into  the  product  of  two  constituent 
matrices ; 

2)  The  latter  are  written  in  terms  of  orthonormal  vectors,  the  elementary 
geometrical  entitles;  and 

3)  These  vectors  are  the  same  for  both  constituent  matrices,  only  the  type  of 
their  components  differs. 

The  decomposition  of  the  rank -def icient  design  matrix  A  offers  geometrical 
insight  that  cannot  be  gathered  from  algebraic  considerations  usually  based  on 
the  column  space  of  A  in  its  original  form,  not  on  spaces  associated  with  the 
more  elementary  matrices  seen  above. 

2.4  Propagation  of  Contravariant  and  Covariant  Metric  Tensors 

We  have  seen  that  the  u ' -dimensional  model  surface,  spanned  by  u' 

orthonormal  vectors  t,  J .  is  embedded  In  the  n-dimensional  observational 

space,  spanned  by  n  orthonormal  vectors  £,  j .  v,  ...  The  model  surface  is 

also  embedded  in  the  u-dimensional  parametric  space,  spanned  by  u  orthonormal 

vectors  l,  j .  t,  ...  The  rank  deficiency  is  rooted  in  the  fact  that  the 

vectors  lying  in  the  model  surface,  including  8,  J,  ...  themselves,  are 
expressed  by  u  parametri c- space  components  (u>u')  rather  than  by  u'  model 
surface  components  as  In  the  full -rank  setup  of  [B] . 

The  above  reference  established  a  perfect  correspondence  between  the 
propagation  of  associated  metric  tensors  and  the  variance-covariance  propagation 
law,  and  between  the  propagation  of  metric  tensors  and  the  weight  propagation 
law.  For  the  most  part,  however,  this  Isomorphism  was  proven  in  conjunction 
with  vectors  lying  In  the  model  surface  and  expressed  through  the  model  surface 
components.  The  scope  of  the  proof  will  now  be  extended  by  showing  that  the 
same  correspondence  can  be  established  if  the  parametric  space  components  are 
used  Instead  Similar  to  [B],  below  we  list  relationships  between  vector 
components,  and  next  to  them  (separated  by  dots)  formulate  the  corresponding 


relationships  between  contravar iant  or  covariant  metric  tensors.  Any  of  these 
relationships  can  be  written  at  once  with  the  aid  of  Table  1. 


In  particular,  this  table  (including  its  extensions  to  the  covariant 
components)  yields 


,  ,a  na,  ,r  na  .  r  ,a| 9  a  ,  rsj9  _a  rs„fl 

du'  =  Q  dx'  =  Q  dx  .  a'  »  Q  g'  Q  =  Q  g  Q  , 


du'  =  A^dx'  =  A®dx  .  a'  =  A®g'  Ar  =  A^g  Ar  . 

P  p  s  p  s  Pa  |36sr  a  £6sr  a 


(14a, b) 

(14c, d) 


Equations  (14a  d)  depict  what  could  be  termed  the  situation  n-u',  indicating 
that  components  in  n  dimensions  are  transformed  into  components  in  u' 
dimensions.  Similarly,  we  deduce 


r  r  a  r  a 
dx'  =  A  du'  =  A  du 
a  a 


,  rs  r  .a/S.  s  ,r  a$  ts 
g'  =  A  a'  A.  =  A  a  KA. 

a  P  a  p 


(15a, b) 


dx' 

s 


Q 


a 

r 


Pa 


(15c, d) 


Equations  (15a  d)  depict  the  situation  called  u'-n.  The  (associated)  metric 
tensors  attributed  a  prime  are  the  "necessary"  tensors  as  described  earlier. 
Table  1  shows  that  the  Q-tensor  is  related  to  the  A-tensor  through 


na  afl  s 
Q  =  a  A  g 
r  (9ssr 


(15e/ 


where  the  a-  and/or  g-tensors  could  be  replaced  by  their  primed  counterparts. 


We  present  an  additional  case  of  interest,  called  the  situation  u'-m,  which 
is  conceptually  quite  similar  to  the  situation  u'  n  reflected  in  (15a  d).  It  is 
based  on  an  m  dimensional  "functional  space",  which  is  yet  another  space 
containing  the  model  surface,  hence  m>u’.  This  space  could  be  thought  of  as 
embedded  in  the  observational  space,  identical  to  it,  or  containing  it, 
corresponding  to  m<n,  m^n,  or  m>n,  respectively.  Much  like  the  observational 
space,  the  functional  space  intersects  the  parametric  space  in  the  model 
surface,  and  has  no  dimension  In  common  with  the  extension  surface  We  could 
thus  imagine  it  as  replacing  temporarily  the  observational  space,  in  which  case 
all  the  tensors  in  Table  1  having  r  and/or  s  as  indices  would  be  attributed  the 
symbol  *,  and  the  lower  case  Roman  letters  themselves  would  be  replaced  by 
another  kind  of  indices  whose  range  would  extend  from  1  to  m  (instead  of  1  to 
n)  Except  for  these  changes,  the  basic  relations  (15a  d)  could  be  rewritten  as 
they  stand,  and  the  same  applies  for  the  connecting  equation  (15e).  One  could 


even  retrace  the  steps  (9a)-(ll)  and  represent  the  new  A-tensor  in  terms 
of  partial  derivatives  by  rewriting  (11)  with  the  sane  notations]  changes. 
Clearly,  the  rank  of  the  A-  and  Q-tensors  would  be  u'  by  construction,  the  same 
as  the  rank  of  their  counterparts  in  (15a-e). 

If  only  the  first  m^  of  the  ■  functional -space  vector  components  were  of 
any  relevance,  the  computation  of  the  corresponding  (associated)  metric  tensor 
would  likewise  be  limited  to  its  first  components.  If,  similarly,  only 

m^u'  functional -space  components  of  the  A-  and/or  Q-tensors  were  known,  one 
could  imagine  their  range  extended  through  m>u'  to  ensure  the  validity  of  the 
relationships  described  in  the  previous  paragraph.  The  actual  components  would 
subsequently  be  computed  only  to  within  the  fist  m^  for  the  desired  vector  and 
to  within  the  first  m^xm^  for  the  corresponding  (associated)  metric  tensor, 
i.e.,  the  parts  imagined  for  the  sake  of  the  theory  would  be  disregarded.  We 
can  thus  conclude  that  whether  the  number  of  functional-space  components  in  the 
A-  and/or  Q-tensors  is  larger  than  u'  or  not,  the  resulting  vector  components 
and  the  corresponding  (associated)  metric  tensor  components  follow  the  pattern 
of  (15a  d). 

In  order  to  highlight  the  isomorphism  between  the  propagation  of 
contravariant  or  covariant  metric  tensors  in  the  geometrical  context  and  the 
propagation  of  variance  covariance  or  weight  matrices  in  the  adjustment  context, 
we  transcribe  (14a)  (15d)  in  matrix  notations.  In  so  doing,  we  adopt  the 
"traditional  identification"  of  (BJ,  whereby  associated  metric  tensors 
correspond  to  variance-covariance  matrices  and  metric  tensors  correspond  to 
weight  matrices.  Due  to  its  adjustment  appeal,  this  identification  was 
preferred  in  (Bj  to  the  "new  identification"  with  reversed  correspondences, 
although  both  identifications  were  shown  to  lead  to  identical  results  In 
concentrating  on  the  variance-covariance  matrices  first,  we  transcribe  (14a, b) 
and  (15a,b)  as 


du' 

=  Qdx ' 

=  Qdx  .  . 

.  .  a'  -  Qg'QT  - 

T 

■  QgQ  . 

(14 ’a, b) 

dx’ 

=  Adu’ 

=  Adu  .  . 

.  .  .  g'  =  Aa'  AT  ^ 

T 

=  Aa  A  . 

( 15 ' a , b) 

The  connection  between  Q  and  A  is  provided  by 


which  follows  from  (15e),  and  where  the  Matrices  a  and/or  g*  could  be  attributed 
a  prime. 

As  can  be  gathered  from  these  relations,  all  of  the  first-  and  second-order 
contravar iant  or  Mixed  tensors  keep  their  syMbols  also  in  Matrix  notations, 
except  that  the  indices  are  dropped.  This  siaplifles  the  notational  conventions 
used  in  [Bj,  where  a  new  set  of  syMbols  was  introduced  in  Matrix  notations  in 
order  to  conforM  More  closely  to  adjustment  notations.  No  confusion  should 
arise  from  a  dual  role  of  the  symbol  dx,  for  example,  which  in  one  context 
designates  a  geometrical  object  associated  with  the  component  set  dx  ,  and  in 

r 

the  other  expresses  the  set  dx  as  a  column  vector.  In  (14'a,b)  and  (15'a.b), 
the  variance-covariance  matrices  corresponding  to  the  (column)  vectors  dx,  dx' , 
du,  and  du'  are  g,  g' ,  a,  and  a',  respectively.  These  equations  express  the 
familiar  variance-covariance  propagation  law  of  adjustment  calculus,  valid 
whether  or  not  any  of  the  matrices  are  rank-deficient.  The  case  described  above 
in  conjunction  with  the  functional  space  would  be  Included  in  (15'a,b),  except 
that  dx',  A,  and  g'  would  be  attributed  the  symbol  *.  It  would  correspond  to 
the  variance-covariance  propagation  applied  to  linear  functions  of  du'.  In 
retrospect,  this  fact  provided  the  motivation  for  the  term  "functional  space". 

According  to  the  discussion  that  followed  (I5e) ,  the  matrix  A  can  be 
written  as 

-  *  T 

A  =  PL*  , 

which  is  the  functional  space  version  of  (13a).  As  a  matter  of  interest,  we 
also  present  this  matrix  in  the  form 

A  -  R A  ,  R  -  FFTg*  . 

where  R  has  the  dimensions  (m*n)  and  the  rank  u'.  The  second  of  the  above 

formulas  has  been  obtained  from  both  versions  of  (13a)  together  with  the 
T 

identity  F  g*F  I ,  but  in  the  present  context  it  is  not  needed.  Although  the 
situation  u'-m  is  illustrated  sufficiently  well  by  equations  (15'a,b)  in  their 
functional  space  version,  we  can  substitute  ARA  in  the  latter  and  write 

dx'  -  Rdx'  .  g'  =  Rg'  R1  , 


1  8 


where  use  has  been  made  of  equations  (15'a,b)  in  their  original  version.  This 
formulation  further  highlights  the  isomorphism  between  the  associated  metric 
tensors  and  the  variance-covariance  matrices. 

The  first  and  second-order  covariant  tensors  keep  their  symbols  in  matrix 
notations  as  well  (with  the  indices  dropped),  but  are  attributed  *  to  be 
distinguished  from  their  contravariant  counterparts.  The  relations  (14c, d)  and 
(15c, d)  are  thus  transcribed  as 

du*'  =  ATdx*'  =  ATdx*  .  a*'  =  ATg*'A  =  ATg*A  ,  (14'c,d) 

dx*'  =  QTdu* 1  =  QTdu*  .  g*'  *  QTa*'Q  «  QTa*Q  .  (15'c.d) 

The  weight  matrices  corresponding  to  the  adjustment  vectors  dx,  dx',  du,  and  du' 
are  g*.  g*',  a*,  and  a*',  respectively.  In  (14'c,d)  and  (15'c,d),  the  weight 
matrices  are  related  to  the  covariant  version  of  the  pertinent  vectors  through 
a  structure  resembling  (14'a,b)  and  (15'a,b)  and  characterizing  the  weight 
propagation  law. 

Equations  (15'c,d)  with  ~  attributed  to  dx*',  Q,  and  g*'  reflect  the 
functional-space  context.  Equation  (15'e)  is  valid  here  in  the  form 

Q  =  aATg*  , 

where  the  matrices  a  and/or  g*  could  again  be  attributed  a  prime.  In 
paralleling  the  development  of  the  previous  paragraph,  we  could  show  that 

Q  =  QS  ,  S  =  FFTg*  . 

where  S  has  the  dimensions  (nxm)  and  the  rank  u'.  Finally,  in  utilizing  both 
versions  of  (15'c,d)  in  conjunction  with  the  first  formula  above,  we  obtain 

dx*'  =  STdx* '  .  g*'  =  STg*’S  , 

which  further  confirms  the  pattern  characterizing  the  weight  propagation  law. 


3.  UNIVERSAL-SPACE  FORMULATION 


3.1  Appeal  of  the  Universal  Space 


The  rank-deficient  parametric  adjustment  differs  from  most  practical 
adjustments  in  one  important  aspect,  the  rank  deficiency  of  the  design  matrix  A. 
In  tensor  notations,  the  rank- deficient  L.S.  setup  is  represented  by 

dxr  =  Ardu'a  <•  dx"r  ,  (16) 

a 

r 

where  the  first  term  on  the  right-hand  side  is  equal  to  dx'  in  accordance  with 
(12).  Equation  (16)  closely  resembles  the  situation  depicted  in  [B]  in  all 

r 

respects  but  the  rank  deficiency  of  the  design  tensor  A^.  In  familiar 
adjustment  notations,  (16)  would  be  transcribed  as 

L  =  AX  -  V  , 


where  L,  X.  and  V  are  the  vectors  of  constant  terms,  parametric  corrections,  and 
residuals,  respectively.  The  vector  L  is  formed  as  L^-L0,  where  L*5  contains 
observations  and  L°  contains  values  of  the  observables  consistent  with  an 
initial  set  of  parameters.  As  can  be  gathered  from  Table  1,  the  geometry 
corresponding  to  a  rank-deficient  model  yields  the  relations  equivalent  to 
singular  normal  equations  in  adjustment  calculus: 


a-adu'  -  du-  ; 

,  .s  .r  .  .  .s  .  r 

a'  3  Aag  A  ,  du'  =  Aag  dx 
Pa  )3&sr  a  j9  pBsr 


(17a) 


(17b, c) 


r  r  oc 

where  dx  ,  A^,  and  gg^  are  given.  Although  all  tensors  in  (17a-c)  except  du' 

are  known,  the  latter  cannot  be  computed  from  (17a)  without  further 

stipulations,  due  to  the  singularity  of  a'  ,  the  necessary  metric  tensor. 

pa 

Just  as  du'a  represents  the  parametric  corrections  in  tensor  notations,  the 
necessary  associated  metric  tensor  a'  p  corresponds  to  the  variance-covariance 
matrix  of  parameters.  As  Table  1  suggests,  both  these  quantities  can  be 

expressed  in  theory  with  the  aid  of  the  associated  metric  tensor  of  the 

.  .  a(3 

parametric  space,  a 


du,<X  -  aa^du’  =  a,a^du’  , 

P  P 

,  a/3  ay  ,  6P  a/3  aj  „  <50 

a  =  a  a'  a  =a-a'a'a 

r<5  r< 5 


(18a) 


(18b) 


20 


where  the  second  equality  In  (18b)  is  the  consequence  of  a"a^=aa7a" _a^ .  The 

afl  r° 

tensor  a  p  can  be  obtained  from 

a^afl  -  <5®  .  (19) 

$7  7 

provided  the  metric  tensor  a.  is  known. 

pot 

r  rs 

Under  the  same  assumption  of  known  a.  ,  the  tensors  dx'  and  g'  are  given 

po 

by  (15a,b),  namely 


,  ,  r  .r,  .a 
dx’  =  A  du'  , 
a 

,rs  ,r  «|S4s  ,r  .afi  s 

g  =  Aaa  %  =  V  A0  ' 


(20a) 


(20b) 


Parallel  to  (18b),  Table  1  yields  the  tensor  g'  as 

sr 

Kr  -  VP\r  '  (21) 

r  rs 

which  follows  also  from  (15d)  with  (15e).  The  tensors  dx'  ,  g'  ,  and  g' 

s  r 

correspond  to  the  adjusted  observations  in  a  linearized  model,  their  variance- 
covariance  matrix,  and  their  weight  matrix,  respectively.  As  has  been  stated  in 

the  previous  chapter,  the  pertinent  functional-space  contravariant  tensors  would 

P  PS  P 

be  treated  in  complete  analogy  to  dx'  and  g’  from  (20a, b),  except  that  dx'  , 

rs  r 

g'  ,  and  Aa  would  be  attributed  the  symbol  ~ .  On  the  other  hand,  one  cannot 
compute  g'gr  in  a  functional-space  version  of  (21)  because  the  metric  tensor  in 
the  functional  space  is  unknown. 


The  foregoing  represents  a  simple  and  plausible  resolution  of  the  rank- 

deficient  model,  hinging  only  on  the  availability  of  the  metric  tensor  a  . 

pa 

Unfortunately,  this  model  offers  no  tensor  relation  containing  a  ,  and  no 

pa 

indication  of  how  the  latter  could  be  obtained.  But  it  is  clear  that  if  the 
isomorphic  geometrical  setup  could  be  "enlarged"  into  one  where  the  parametric 
space  constituted  a  proper  model  surface,  the  metric  tensor  for  such  a  surface 
could  be  expressed  following  the  simple  approach  of  [B].  One  is  thus  motivated 
to  turn  to  the  universal  space  in  the  role  of  an  enlarged  observational  space, 
guided  by  the  realization  that  the  parametric  space  can  indeed  be  considered  as 
a  new  model  surface  embedded  in  the  enlarged  observational  space. 


»  ■  ■  in 


3 . 2  Basic  Universal -Space  Setup 


In  pursuing  the  Idea  suggested  In  the  previous  section,  we  present  a 
geometrical  situation  called  "modified",  where  the  model  surface  is  extended  to 
coincide  with  the  parametric  space.  The  latter  Is  embedded  in  the  universal 
space  by  construction.  The  modified  surface,  endowed  with  the  coordinate  system 

<ua>.  a=l,2 . u,  is  spanned  by  u  orthonormal  vectors  8,  j,  ...  t,  ...  And  the 

universal  space,  endowed  with  the  coordinate  system  {X^},  R^l,2 . N,  is 

spanned  by  N=u*n"  orthonormal  vectors  8,  j .  t,  ...  ,  v ,  ...  Suppose 

momentarily  that  the  following  three  tensors  are  known: 


dX* 


„R  .  .R  ..R  R 

a8  *  b  J  *  ...  *  zt  +...*■  qv  +  ... 


.R  3Vr/2  a 
A  ?  3X  /du 
a 


. R .  ,R  ,  R 

88  +  jj  -»...+  t  t  +  .. 

a  a  a 


RS  R  „S  R  .S 
g  =  8  8  +  j  j  + 


.  R  .  S  R  S 

+  t  t  *  ...  v  u  + 


(22a) 

(22b) 

(22c) 


This  case  would  then  represent  the  situation  discussed  in  [B],  if  one  overlooks 
the  conceptually  unimportant  addition  of  t,  ...  to  the  original  set  of  u'  model 
surface  base  vectors  8,  J,  ... 


A  full-rank  L.S.  setup  now  corresponds  to 
dX^  =  dX'R  +  dX"R  , 


....R  „R  ,  a 
dX'  =  A  du 
a 


(23a) 

(23b) 


where  dX'  and  du  are  the  same  geometrical  object  expressed  in  different 
coordinate  systems,  represented  by  "a"  units  along  the  vector  8.  "b"  units  along 
the  vector  j,  ...  ,  "z"  units  along  the  vector  t,  ...  On  the  other  hand,  dX '  is 
represented  by  "q"  units  along  the  vector  v,  ...  Similar  to  [B],  the  relation 


,,S  .R .  ,  a  AS  R 

(A/3gSRAa)dU  =  Aj3  gSRdX 


(24) 


where  the  tensor  in  parentheses  is  the  metric  tensor  a.  of  the  modified  mode) 

pa 

surface,  is  equivalent  to  (nonsingular)  normal  equations. 

The  metric  tensor  g  needed  in  (24)  can  be  computed  from  the  associated 
RS  ^>*'  olB 

metric  tensor  g  Similarly,  a  can  be  computed  from  a^,  giving  rise  to  the 

solution  dua^aa^du  ,  where 
P 


22 


a 


+  ...  r  Z  t 


P 

I 

( 

t 


du 


a 


a£> 


. a  .a  .(S 

f  t  +  J  J  * 


*  tV  ♦ 


which  already  appeared  in  Table  1.  The  analytical  for*  of  the  covariant  tensors 

du.  and  a0  taking  part  in  (24)  would  be  written  in  analogy  to  the  above,  with 
p  pa 

subscripts  replacing  the  superscripts.  Paralleling  the  demonstration  in  [B], 
the-  standard  L.S.  criterion  is  reflected  by 


,V„S  .V„R  2 
dX  gSRdX  =  9  + 


minimum  . 


(25) 


3 . 3  First  Stipulation 

The  case  presented  above  is  of  little  practical  use  because  none  of  the 
R  R  RS 

quantities  dX  ,  A^,  and  g  is  part  of  an  actual  geometrical  setup.  But  upon 
using  two  stipulations,  such  a  system  can  be  developed  Into  one  featuring 
quantities  that  are  either  known  from  the  rank-deficient  model  or  can  be  chosen 
essentially  arbitrarily.  The  first  stipulation  affects  vectors'  configuration 
by  restricting  dX  to  the  original  (n-dimensionai )  observational  space,  i.e.,  by 
enforcing  z=...=0.  This  means  that  the  orthonormal  vectors  t,  ...  no  longer 
play  any  role  in  describing  dX,  dX',  or  du.  Since  the  vector  dX'  and  its 
equivalent,  du,  are  now  restricted  to  the  original  (u1 -dimensional )  model 
surface,  it  is  more  convenient  to  replace  the  notation  du  by  du'  and  write 
dX' 2du' . 

Consistent  with  the  first  stipulation,  (22a)  becomes 

dX8  =  atR  >  bjR  t  ...  f  qi/R  t  ...  (26a) 

For  the  sake  of  completeness,  we  also  list 

dX'R  -  a£R  +  b  jR  +  .  .  .  .  (26b) 

dX"R  =  quR  +  . .  .  (26c) 

The  vector  du'  Is  expressed  as  in  Table  1.  With  regard  to  the  geometrical 
representation,  equations  (26a-c)  and  Table  1  Indicate  that  the  vectors  dX , 
dX'sdu1,  and  dX"  are  the  same  objects  as  dx,  dx'sdu',  and  dx".  respectively. 
Thus,  in  considering  Fig.  1,  the  vector  denoted  dx  could  be  described  by  the 
symbols  dX,  dx ;  the  vector  denoted  dx',  du'  could  be  described  by  the  symbols 

?  3 


dX',  dx' ,  du';  and  the  vector  denoted  dx"  could  be  described  by  the  symbols 
dX".  dx". 


The  first  stipulation  has  not  changed  anything  on  tensors  in  (22b. c).  And 
although  it  has  altered  the  geometry  of  dX  and  dX',  it  has  not  affected  the  form 
of  (23a)  as  is  readily  apparent  from  (26a-c).  Equations  (23b)  and  (24)  also 
remain  the  same,  except  that  the  notation  du'  now  replaces  du.  With  this 
change,  equations  (23a, b)  are  recapitulated  for  future  reference  as 


R  R 

dX'  *  dX" 


(27a) 


dX'R  =  AKdu'a 
a 


(27b) 


In  the  same  vein,  (24)  is  recapitulated  in  the  form 


Vdu'  ■  %  ■ 

%  ■  4eKsRas  •  %  •  A^SRdxR 


(28a) 


(28b, c) 


3.4  Second  Stipulation 


The  second  stipulation  pertains  to  the  choice  of  the  universal  space 
coordinate  system,  and,  as  such,  cannot  be  included  in  Fig.  1  or  a  similar 
geometrical  Illustration.  This  coordinate  system  is  defined  by 

(XR>  <xr.wA>  .  I 


r  A 

where  (x  )  and  (w  }  represent  coordinate  systems  in  their  own  right.  The  latter 
are  depicted  in  (5a)  and  (5d),  and  belong  to  the  observational  space  and  the 
extension  surface,  respectively.  Since  the  observational  space  and  the 
extension  surface  are  orthocomplements  of  each  other  in  the  universal  space,  it 
follows  in  perfect  analogy  to  the  interim  coordinate  system  of  Chapter  2  that 
the  universal  space  coordinate  system  is  normal.  Tn  drawing  on  this  analogy,  we 
can  state  that  the  last  u"  universal  space  components,  contravar i ant  and 
covariant,  of  vectors  lying  in  the  observational  space  are  zero,  as  are  the 
first  n  components  of  vectors  lying  in  the  extension  surface.  The  remaining 
universal  space  components  are  identical  to  their  counterparts  formed  in  the 
respective  subspaces.  These  properties  are  used  extensively  in  the  next  three 
paragraphs 


The  universal -space  components  of  the  orthonormal  vectors  lying  in  the 
observational  space  are 


«R  =  («r.O)  .  jR  =  (Jr.O) . vR  =■  (vr,0) .  (30a) 

«R  -  («r.O)  .  jR  »  (Jr.O) . vR  =  (w.,0) .  (30b) 


while  the  coaponents  of  the  orthonoraal  vectors  lying  in  the  extension  surface 
are 


t 


R 


(0  .  tA) 


(30c) 


tR  =  (0. tA)  ,  ...  ( 30d ) 

With  (30a-d).  the  unknown  tensors  of  the  universal  space  setup  can  easily  be 
separated  into  those  given  as  a  part  of  the  original  rank  deficient  aodei .  and 
those  that  are  unknown  but  can  be  chosen  at  will  (subject  to  soae  general 
restrictions).  For  example,  the  coaponents  in  (26a  c)  are  seen  to  be 

dX**  (dxr,0)  ,  dX,R  (dx  ’ r ,  0 )  ,  dX"R  (dx"',0)  ,  (31a, b.c) 

which  i ould  also  he  written  in  the  covariant  version.  The  entire  set  dX**  is  now 

r 

known  because  the  set  dx  represents  the  known  coaponents  of  the  observational 
vector . 


If  we  apply  equations  (30a, c)  to  (22b),  we  obtain 


AK  =  (Ar . QA) 
a  a  a 


(32) 


where  both  tensors  on  the  right  hand  side  appeared  in  Table  1.  If  the  same 
equations  are  further  applied  to  (22c),  it  follows  that 


RS 

g 


rs 


kA°) 


( 33 ) 


where  both  tensors  on  the  right  hand  side  also  appeared  in  Table  t.  Equation 
(33)  can  be  related  to  the  normal  system  described  by  (8a)  and  the  text  that 
followed.  Similar  to  (8b),  we  also  have 


RSR  ~  (Ksr ' kQA) 


(34) 


Equations  (32)  (34)  contain  tensors  which  are  known  from  the  rank  deficient 
r  rs 

model,  namely  A  ,  g  ,  and  g  ,  as  well  as  tensors  which  are  as  yet  unknown, 
A  AO  “  sr 

namely  Q  ,  k  ,  and  k  A  We  notice  thHt  with  (31c)  and  (34),  the  quadratic 
a  flA 

form  (25)  becomes 


i  *h"i 


25 


which  corresponds  to  the  standard  L.S  criterion  in  the  original  formulation 
(full  tank  as  well  a9  rank  def i cient ) .  This  confirms  that  the  basic  premise  of 
the  geometrical  setup  is  kept  intact  by  the  uni  versa! -space  approach. 


Finally,  using  (31a  c)  and  (32),  we  can  rewrite  (27a.b)  as 

(dxr.O)  (Ar.QA)dn,a  «  (dx"r,0)  .  (36) 

a  a 

Similarly,  using  (31a),  (32),  and  (34)  in  equations  (28a  c),  we  obtain 


vdu 

.  ° 

%  ^ 

( 37a  ) 

% 

a  ' 

3a 

'  “Sa  ' 

,  * 8  ,  r 

a'  =  A„g  A 

0a  0Ksr  a 

„  rO  A 

a0a  "  Q0kOAQa  : 

(37b, c.d) 

du’ 

Alg 

dxr 

sr 

( 37e ) 

The  above  relations,  consistent  with  Table  1.  represent  normal  equations  in  the 

universal  space  approach.  As  their  notations  indicate,  the  necessary  metric 

tensors  a^  and  a^a  pertain  respectively  to  the  model  surface  and  to  the 

extension  surface.  The  tensors  a'  and  du’  are  known  from  the  rank 

(3a  (3 

deficient  formulation  of  normal  equations,  and  are  given  explicitly  in  (17b, c). 
while  the  tensor  a"  is  as  yet  unknown. 


3.5  General  Form  of  the  Universal  Space  Resolution 


The  foregoing  development  has  illustrated  that  although  the  notion  of 

not ma  I  coordinates  plays  a  substantial  role  in  the  derivation  of  tensor 

equal  ions  suited  to  our  needs,  the  coordinates  themselves  are  neither  needed  nor 

known  Indeed,  if  tensor  equations  are  established  in  one  coordinate  system, 

they  are  valid  in  any  coordinates  As  a  fundamental  feature  of  this  chapter, 

such  equations,  formulated  in  the  universal  space  endowed  with  the  normal 

coordinate  system  (X*).  allow  us  to  transfer  the  desired  tensors  from  the  rank 

deficient  context  to  the  familiar  full  rank  context.  This  advantage  is  best 

reflected  by  comparing  equations  (17a)  and  (37a),  where  the  singular  tensor 

a'  in  the  former  is  replaced  by  the  nonsingular  tensor  a.  in  the  latter. 

a  -  f><* 

The  formulation  of  the  basic  quantities  du’  and  a'  then  proceeds  as  in  (18a) 

r  r  s 

and  (18b),  respectively.  And  the  formulation  of  dx’  ,  g'  ,  g^ ,  and  the 
remaining  quantities  of  interest  proceeds  as  outlined  in  (20a)  (21)  and  the  text 


that  followed  We  have  thus  witnessed  how  the  universal  space  approach 
facilitates  the  resolution  of  the  rank  deficient  model  conceptually,  through 
tensor  equations  In  the  next  step,  we  address  the  task  of  choosing  the  tensors 
as  yet  unknown  In  order  to  resolve  this  model  numerically  as  well 

Equations  (17b  d)  show  that  aa  Is  obtained  from  a.  by  the  addition  of 

pa  pa 

an  essentially  arbitrary  tensor  a"  The  choice  of  the  elements  of  a"  Is 

A  pa  pa 

made  through  k  .  and  Q  The  tensor  k„A  must  be  positive  definite 
On  a  On 

(symmetric),  but  nr  her  wise  can  be  completely  arbitrary  The  tensor  Q  must 

a 

r 

have  the  full  rank  in  A.  and,  when  Joined  to  A  ,  must  form  a  full  rank  tensor 

a 

In  a,  but  otherwise  can  also  be  completely  arbitrary  As  the  process  leading 
from  (25)  t  o  (:<r>)  attests,  the  choice  of  these  two  tensors  has  no  bearing  on  the 
!,  S  criterion 


Although  the  rank  deficient  setup  is  now  solved  in  general,  the  numerical 

Cl  Cl  fl 

outcome  for  the  basic  tensors  du '  and  a'  Is  non  unique,  due  to  the 

arb 1 1 rar i ness  In  a.  propagated  into  a.  The  nature  of  this  arbitrariness 
Pa  pa 

could  be  related  to  the  coordinate  system  (u  }  and  Its  variations,  but  the 
present  study,  concerned  with  tensor  relations  and  tensor  components,  has  no 
need  to  link  the  latter  to  any  coordinates  explicitly.  We  observe,  however. 

f  PS 

that  the  tensors  dx '  ,  g'  ,  and  g^  from  (20a, b)  and  (21)  are  unique 
A  similar  statement  can  be  made  with  respect  to  the  functional  space  version  of 
(20a, b).  whereas  such  a  version  Is  inconsequential  for  (21)  clue  to  the  unknown 
metric  tensor  g  The  uniqueness  property  is  rooted  in  the  fact  that  the 
components  expressed  in  terms  of  ( u° )  are  eliminated  by  trnsor  contractions 


We  note  that  if  the  tensor  QA  were  given,  the  outcome  for  du'a  and  a ' 

a 


would  also  be  unique,  regardless  of  k 


QA 


This  stems  from  the  fact  that 


a '  i 
pa 


P 


qA«a 

a 


and  from  similar  identities  for  the  parametric  space  components  of  the  remaining 
orthonormal  vectors  lying  in  the  model  surface.  J.  ..  The  first  identity 
offers  u'  independent  relations  for  8°,  a-  1  , 2 . 


provides  additional  u  Independent  relations  The  component  sets  8°.  j™ 


are  thus  expressible  through  and  , 


ii,  and  t  fie  second  identity 
a  a 

component  sets  8  i 
with  k„.  playing  no  role*  at  .ill 


fiA 


Implied  In  this  demonstration  Is  the  requirement  that  must  have 

the  full  rank  In  a  which  is  satisfied  due  to  the  above  condition  for  QA 

a 


?  7 


/  t ^ 1 


■  W*u ufc  Mfejwjk 


'jA  Z-f' 


m>».V.llV'.l/.i  rf.iV.  .V  I V.irf,  >V,  *J 


n  Q 

In  principit'  with  only  a.  and  du .  known,  the  outcome  for  a"  .  a„  .  a  p, 
a<3  3a  3  A  3a  3a  a 

and  a  is  affected  by  both  tensors  k  .  and  Q  .  the  outcome  for  du'  and 
,  .  tlA  a 

dp  A  r  r  8 

a  is  af feited  by  Q  alone,  and  the  outcoae  for  dx  '  .  g '  .etc  discussed 

a 

in  the  previous  paragraph,  is  unique,  affected  by  neither  of  the  two  tensors 

We  now  summarize  the  key  formulas  from  this  chapter,  transcribing  thea  in 
aatnx  notations  according  to  the  siaple  convention  introduced  earlier  (the 
indites  are  dropped  and  the  syabols  representing  covariant  tensors  are 
attributed  •)  We  begin  with  the  universal  spare  setup  (36).  which  now  reads 

dx  A  dx' 

du'  ♦  (38) 

.0  !  Q  ;  0  ; 

C  -  L  ^  j  L  J 

wtiere  the  fust  matrix  on  the  light  hand  side  has  the  full  coluan  rank  u  Since 
u  is  the  saallest  possible  nuaber  of  rows  which,  when  augaentlng  A.  can  raise 
it  •-  lank  to  u,  the  second  equation  In  (.38)  represents  what  is  referred  to  in 
ndiustaent  literature  as  miniaal  constraints,  Q  being  the  ainiaal  constraint 
matrix  in  practice,  this  matrix  is  often  supplied  or  chosen  beforehand  It  is 
currently  regarded  as  arbitrary,  provided  it  fulfills  the  conditions 


r.ink  ( Q)  u 


( 39a . b ) 


■  i early.  (39b)  could  not  hold  true  without  (39a)  Although  the  necessary 
iiculit  inn  1 39a )  need  not  be  listed  separately,  it  can  serve  in  a  first  instance 
vt  rut  my  of  y  The  rank  condition  (39b)  could  equivalently  be  written  with 
t  *  r i'p  1  ai  i  ng  A 


The  universal  space  approach  treats  (38)  as  a  full  rank  adjustment  model 
w  i  Mi  the  weight  matrix  d lag . ( g* , k*  )  .  Tiie  latter  is  composed  of  the  diagonal 
subaatrices  g*  and  k*.  while  the  off  diagonal  subaatrices  are  zero.  The  symbols 
g*  and  k*  denote  weight  matrices  in  their  own  right,  the  first  belonging  to  the 
observational  space  and  the  second  belonging  to  the  extension  surface  The 
positive  definite  (symmetric)  matrix  g*  is  the  weight  matrix  of  observations 
obtained  as  g*  g  '.  where  g  is  a  given  variance  covariance  matrix  of 
observations  On  the  other  hand,  the  symmetric  matrix  k*  is  arbitrary,  subjei  t 
inly  to  the  i  mull t ion  that  it  must  be  positive  definite  The  geometrical 
ns  iderat  ions  above  have  indicated  that  although  k*  affects  a*",  a*,  a.  and  a", 
His  mat  mx  has  no  beat  i  rig  on  the  determination  of  do'  and  a'  I  in  addition  to 


dx',  g' .  etc  )  This  Is  consistent  with  the  statement  on  page  17  of  (Pope, 

1 973 1  .  that  "minimally  constrained  solutions  do  not  depend  on  E  associated  with 
the  minimal  constraint",  where  E  is  our  (k*)  5»k. 


In  forcing  noraal  equations  froa  (38),  one  obtains  foraulas  paralleling 


(37a  e) 


Mu'  du*  1 


(40a) 


a*  ♦  a" 


a*’  =  ATg*A  .  a*"  =  QTk*Q  ; 


( 40b , c , d ) 


ATg*dx 


(40e) 


Here  the  quantities  known  froa  the  rank  deficient  L.S.  setup  are  A  (the  design 
aatrix).  g*  ( t he  weight  aatrix  of  observations),  and  dx  (the  vector  of 
observations  in  a  linearized  aodel),  which  give  rise  to  a*'  (the  singular  aatrix 
of  noraal  equations)  and  du* '  (the  right  hand  side  of  noraal  equations). 
According  to  (18a.b),  du '  and  its  variance  covariance  aatrix  a'  are  coaputed 


du '  adu* 1  -  a ' du* '  , 


(41a) 


a  a p  a  =  a  a  a  p  a 


(41b) 


where ,  in  v lew  of  ( 19 ) 


a  ( a  *  | 


The  second  equality  in  (41b)  uses  the  fact  that  a"=aa*"a  The  second  equalities 
it)  both  nl  (41a.b)  ran  serve  for  verification  purposes 

With  regard  to  the  vector  dx '  containing  the  adjusted  observations  in  a 
linearized  model,  and  to  its  variance  covariance  matrix  g',  from  (20a, b)  we 
t  r  ans<  r  i he 


1 1  y  Adu' 


(43a) 


T  T 

A  a  A  A  a  '  A 


(43b) 


The  set ond  equality  l n  (43h)  ran  again  serve  for  ver I f icat ions  If  needed,  the 
weight  matrix  g*  associated  with  dx '  can  he  transcribed  from  (21)  as 

g*  g*  g  g*  ( 44  ) 


z  V  z  .-’  w 

a  * .  , .  a*.  A  •  i  fp  iW  ~  A  ^  m>,  Nk  mi.wmirtu.m 


.V  A  A  AlA  A -A. 


(44  ) 


Although  the  matrix  a*"  in  (40d)  and  thus  also  a*,  a,  and  a"  are  non  unique  due 
to  admissible  variations  in  Q  and  k*.  and  although  the  matrix  a’  as  well  as 
the  vector  du'  are  non  unique  due  to  admissible  variations  in  Q  alone,  the 
q  tnliiies  dx' ,  g' ,  and  g*'  above  are  unique.  Equations  (43a, b)  could  also  be 
used  in  conjunction  with  linear  functions  of  du',  in  which  case  A,  dx'.  and  g' 
would  be  attributed  the  symbol  The  vector  dx '  and  its  variance-covariancc 
matrix  g’  would  then  be  unique  as  well.  On  the  other  hand,  the  weight  matrix 
g*  ’  could  not  be  computed  in  analogy  to  (44)  because  g*  is  unknown.  Since  the 
solution  du'  and  its  variance-covariance  matrix  a1  become  unique  if  Q  is 
specified  numerically,  the  latter  will  be  subject  to  further  discussion. 


4.  MINIMAL-CONSTRAINT  FORMULATION 


4 . 1  Geometrical  Background 

The  treatment  of  the  rank-deficient  adjustment  in  the  preceding  chapter  has 
resulted  in  an  extended  full  rank  formulation,  such  as  presented  in  (38)  and 
beyond.  Here  we  describe  another  approach,  where  the  rank -deficient  adjustment 
is  addressed  via  minimal  constraints.  We  begin  with  a  geometrical  setup  in  the 
universal  space,  comprising  two  sets  of  equations.  The  first  set  depicts  the 
rank  deficient  L.S.  setup  (16),  or,  equivalently,  the  tensor  form  of  singular 
normal  equations  appearing  in  (17a): 


a^du'  -  du^ 
And  the  second  set  reads 


QAdu,a  =  0  , 
a 


(45a) 


(45b) 


which,  in  itself,  is  an  identity  as  indicated  by  Table  1,  But  when  considered 
in  conjunction  with  (45a),  it  ensures  that  du'a  cannot  be  substituted  for  by 
dua=du ,a+du "a  with  a  nonzero  set  du"®.  In  terms  of  geometrical  objects,  it 
ensures  that  the  model  vector  du '  cannot  be  substituted  for  by  a  general  vector 
du  from  the  parametric  space  as  could  be  done  in  (45a)  alone,  i.e.,  that  du"sO, 
where  du  is  a  vector  lying  in  the  extension  surface. 

In  elaborating  on  this  assertion,  we  express  the  components  of  a  vector 
lying  in  the  extension  surface  in  two  coordinate  systems.  We  use  the  system 
<ua)  from  (5b),  in  which  case  the  vector  is  symbolized  by  du",  and  the  system 
(wA)  from  (5d),  in  which  case  it  is  symbolized  by  dw.  The  geometrical  object 
du"sdw  is  described  analytically  in  Table  1.  This  table  enables  us  to  relate 
component  sets  of  du’^dw  to  each  other  through  the  Q-tensor  by 


.  A  -A  ,  „a 
dw  =  Q  du 
a 


%  ’  ■ 


(46a, b) 


If  du'  ^-dw  is  a  zero  vector,  all  Its  components  are  zero  in  any  coordinates,  and 
vice  versa.  Suppose  now  that  the  component  set  du ' a  in  (45a, b)  is  substituted 
for  by  dua=du ' a *du',a .  The  new  equation  (45b)  then  becomes 


0  =  QAdu'° 
a 


„a  -A  ,  „a  .A 
Q  du  =  Q  du  =  dw 
a  or 


^  i  - 


where  use  has  been  made  of  (46a).  But  this  means  that  du”  dw  is  restricted  to 


zero.  We  can  thus  conclude  that  (45b)  used  in  conjunction  with  any  relation 
containing  du'a  ensures  that  no  general  set  dua  is  allowed  to  replace  du,a. 


4.2  General  For*  of  the  Minimal  Constraint  Resolution 


We  have  just  seen  that  no  components  du"  other  than  zero  are  allowed  in 

the  solution  of  (45a, b).  Thus,  since  du"  is  a  zero  vector,  one  can  use  (46b) 

with  du"=0  and  write 
p 

^d"n  ■ 0 

These  zero  components  can  be  freely  added  to  (45a),  which,  when  combined  with 
(45b),  gives  rise  to  the  system 


Vdu  “  *  ’  %  ■ 

QAdu'a  =*  0  . 

a 


(47a) 


(47b) 


Equations  (47a, b)  represent  the  standard  formulation  of  normal  equations  with 
(absolute)  constraints  in  adjustment  calculus,  where  the  new  notation  dw^ 
corresponds  to  the  Lagrange  multipliers.  These  multipliers  are  thus  given  a 
clearcut  geometrical  interpretation  illustrating  why  they  must  be  zero  in  a 
rank  deficient  adjustment  with  minimal  constraints. 


In  working  with  matrix  notations  from  this  point  on,  we  transcribe  the 
system  (47a, b)  as 


0  |  i  dw 


An  analytical  inversion  of  the  regular  (symmetric)  matrix  in  (48)  necessitates 
the  following  matrix  identities  transcribed  from  their  tensor  counterparts: 


a-  a’**  *  Q°aI 


a*  ’  a'  ♦  Q  A  -  I  , 


=  0 

Q3a'0r  "  0 
nA  J3 


a*  '  A  =  0  , 


Qa'  -  0  , 


QA  =  I  . 
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The  matrix  relations  presented  above  yield 


That  the  Matrix  in  (49)  Is  the  Inverse  of  the  matrix  in  (48)  is  demonstrated 
upon  forming  their  product  In  either  order  and  obtaining  I.  This  constitutes  an 
easy  proof,  in  retrospect,  that  the  matrix  in  (48)  is  regular.  Equation  (49) 
results  in 

du 1  -  a'du*'  ,  dw*  =  0  ,  (50a, b) 

where  (50a)  is  the  second  equality  in  (41a),  and  (50b)  corresponds  to  the 

identity  A**du'=0  implied  by  Table  1. 

t.  a 

According  to  the  adjustment  theory,  the  variance-covariance  matrix  of  the 
parametric  solution  is  the  leading  submatrix  in  (49).  This  can  be  regarded  as 
an  independent  confirmation  that  the  necessary  associated  metric  tensor  a'  p 
indeed  corresponds  to  the  variance-covariance  matrix  sought  by  the  adjustment. 
Further  agreement  with  the  theory  is  evidenced  by  the  results  (50a, b) 
themselves,  as  well  as  by  the  zero  diagonal  submitrix  in  (49).  One  notices  that 
(49)  furnishes  a'  without  proceeding  through  an  inversion  of  the  positive- 
definite  matrix  a*  of  dimensions  (uxu)  as  was  the  case  in  Chapter  3.  However, 
the  current  procedure  requires  an  inversion  of  the  matrix  In  (48),  whose 
dimensions  are  [(u+u" )x (u*u")J ,  and  which  is  not  positive-definite.  With  regard 
to  dx',  g' ,  g* ,  and.  eventually,  dx'  and  g',  equations  (43a),  (43b)  without  the 
middle  equality,  and  (44),  as  well  as  the  text  that  followed,  apply  perfectly 
well  also  in  the  present  situation.  Similar  to  the  closing  statement  in 
Chapter  3,  the  numerical  outcome  for  du'  and  a'  depends  on  the  explicit  form  of 
Q  yet  to  be  considered. 
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5.  ANALYTICAL  FORMULATION 


N 


5 . 1  System  of  Orthonornal  Vector  Components 


A  complete  description  of  a  general  object  In  parametric-space  components, 

contravariant  and  covariant,  is  related  to  the  components  of  all  the  orthonormal 

vectors  4,  j .  t,  ...  Since  £  ,  j  ,  ...  can  be  determined  from  the 

a  a 

known  tensor  a'  ,  it  follows  that  t  ,  ....  or  an  equivalent  set  of  u"xu 
jSa  a 

components,  must  be  chosen  in  some  manner.  The  remaining  components  can  then  be 
found  from 


£a  £ , 


a  . 

*  J  J, 


♦  tV 


or,  equivalently,  from  the  identities 


£  £a  =  1  ,  £  ja  =  0  , 

a  a 


(51a) 


(51b) 


As  its  analytical  form  suggests,  the  tensor  is  closely  linked  to  the 
components  of  t  ,  . . .  Accordingly,  a  satisfactory  description  of  this  tensor 
can  be  made  only  after  an  analysis  of  interrelationships  among  the  parametric- 
space  components  of  £,  j,  ...  ,  t,  ... 


A  collection  of  the  above  parametric -space  components  expressed  in  a  given 
coordinate  system  (ua)  is  called  "system  of  orthonormal  vector  components",  or 
simply  "system".  Any  such  system  must  fulfill  (51a, b).  If  (ua)  changes,  the 
system  also  changes  (i.e.,  some  or  all  of  the  covariant  and  contravariant 

components  of  £  ,  j .  t,  ...  change),  but  the  formulas  (51a, b)  must  again  be 

satisfied.  In  this  study,  one  such  system  will  be  considered  initial,  and 
others  will  be  considered  its  variants.  However,  the  underlying  (ua)  and  its 
variants  are  of  no  interest  here. 


The  analysis  is  facilitated  if  the  vector  components  are  grouped  in 
matrices  In  analogy  to  (13b,c).  This  does  not  detract  from  the  geometrical 
nature  of  the  present  development,  and  does  not  constitute  a  mixed  algebraic- 
geometrical  approach.  It  is  merely  a  convention,  where  the  geometrical  quality 
of  the  pertinent  matrices  is  kept  in  focus  through  a  matrix  equivalent  of 
(51a, b).  The  components  of  £,  j .  t,  ...  are  grouped  as  follows: 

L*  -  [(£  If J  ]  ■  •  I  •  h  ( f £a J ( Ja I  •  ■ ■  I  .  (52a. b) 

a  a 

T*  -  f[t.J  .  .  ]  .  T  =  [[taj  .  .  .  ]  ,  (52c.  d) 

3  4 


where  [t  ],  etc.,  represent  column  vectors.  The  matrices  L*  and  L  have  the 
dimensions  (u*u'),  while  T*  and  T  have  the  dimensions  |u*u").  The  grouping  seen 
in  (52a)  already  appeared  as  (13c).  Prom  their  construction,  it  is  clear  that 
all  four  matrices  above  have  the  full  column  rank,  which  is  u’  for  L*  and  L.  and 
u"  for  T*  and  T. 

The  terra  "system”  describing  the  collection  of  vector  components  can  be 
used  interchangeably  in  reference  to  the  four  matrices  above,  which  assemble  and 
arrange  these  components  in  a  prescribed  order.  In  view  of  (51a, b),  any  such 
system  must  fulfill  the  following  criteria: 

LL*T  ♦  TT*T  =  I  .  (53) 

L*TL  =  I  .  L*TT  =  0  .  T*TL  =  0  ,  T*TT  -  I  .  ( 54a ,  b ,  c  ,  d ) 

Equation  (53)  and  the  set  (54a-d)  are  equivalent,  expressing  the  conditions  CD=I 

and  DO  I ,  respectively,  where  the  regular  matrices  C  and  D  are  formed  as  0[L  T] 
T 

and  D=[L*  T*]  .  In  either  case,  we  have 

[L  T]  =  { [L*  T*]T)-1  .  (55) 

In  analogy  to  a  previous  statement,  one  system  fulfilling  (53)  can  be  considered 
initial,  and  others  can  be  considered  its  variants.  Each  of  the  latter  must 
again  satisfy  the  condition  (53)  or,  equivalently,  (54a-d).  All  possible 
variants  of  an  initial  systems  (including  the  latter  itself)  are  said  to 
constitute  a  family  of  systems. 

Of  the  four  matrices  L*,  L,  T*.  and  T  forming  a  system,  the  matrix  L*  is 
considered  to  be  known  since  it  can  be  obtained,  for  example,  by  the  Choleski 
algorithm  for  positive  semi-definite  matrices.  This  algorithm  is  applied  below 
to  the  matrix  of  normal  equations,  a*',  which  can  be  transcribed  from  Table  1  as 

a*'  =  L*L*T  .  (56) 

Without  any  loss  of  generality,  the  (u'xu1)  leading  submatrix  of  a*',  denoted 

N  ,  can  be  assumed  positive- def inite.  In  practice,  this  is  true  either  a 

priori,  or  can  be  achieved  upon  reordering  the  parameters.  The  other 

T 

submatrices  of  a*'  are,  clockwise,  N  N  and  N  ,  where  N  N  . 

1  b  bL  fa  1  fat  1  fa 


V*  V  V  V 


Consistent  with  the  partition  of  a*',  the  matrices  L*,  L,  T*.  and  T  are 


partitioned  into  two  submatrices  each.  The  first  submatrix  contains  u'  rows  and 
is  attributed  a  prime,  while  the  second  submatrix  contains  the  remaining  u"  rows 
and  is  attributed  a  double  prime.  The  partitioned  matrices  are  presented  as 


Due  to  the  above  stipulation  for  N ^ ^ .  the  submatrix  L*'  must  be  regular.  Since 

Nu  =  L* '  L*  1 T  , 

T 

it  follows  that  \*'  can  be  determined  by  the  familiar  Choleski  algorithm  for 

positive  definite  matrices,  which  assigns  zero  values  to  u ’ ( u 1  - 1 ) /2  arbitrary 

T 

elements  and  groups  them  below  the  main  diagonal.  The  submatrix  L* '  is  thus 
upper  triangular  and  L*'  is  lower-triangular.  From  the  submatrix  N  of  a*', 

1  Ct 

one  can  determine  L*"  through 
L*  ’,T  =  ( L  *  ' )  ~ 1  N  ■ 


The  submatrix  N  of  a*'  does  not  lead  to  any  new  relations;  but  utilizing  the 
“  -1 

above  two  equations,  we  confirm  that  N  =N  N  Nt-  as  it  should. 

Clearly,  the  "Choleski  choice"  for  arbitrary  elements  of  L*'  is  neither  a 
theoretical  nor  a  practical  necessity.  In  fact,  there  exists  an  infinite  number 
of  other  acceptable  choices,  and  they  will  be  discussed  in  principle  later.  But 
for  the  time  being,  L*'  and  thus  the  resulting  matrix  L*  represent  fixed 
entities  in  our  system.  It  follows  from  the  above  that 

L*  =  (I  R]TL*'  ,  (57) 


R  -  (L*' VJ  L*"T  *  n"Jni2  .  (58) 

The  matrix  R  of  dimensions  (u'*u")  is  known  from  a*',  and  is  fixed  throughout. 

So  far,  little  has  been  said  with  regard  to  the  matrices  L,  T* ,  and  T, 
except  that  they  must  conform  to  (53)  or  (54a  d).  The  matrix  f,  is  especially 
important  because  it  serves  in  forming  a',  transcribed  from  Table  1  as 


a 


(59) 


and  in  forcing  du' ,  similarly  transcribed  as 

du '  ~  I,  y  .  (60) 

where  y  is  a  column  vector  of  u'  elements,  containing  the  constants  a,  b,  ... 

The  values  in  a'  and  du'  depend  on  a  particular  choice  of  L  from  the  family  of 
systems,  but  the  constants  a,  b,  ...  are  tensor  invariants,  expressed  from 
Table  1  as 

a  =  eadu'  ,  b  =  jadu'  ,  ... 

a  a 

In  matrix  notations,  the  unique  vector  y  is  thus  given  by 

y  =  LTdu* 1  =  LTATg*dx  .  (61) 

Accordingly,  equation  (60)  can  also  be  written  in  the  form 

du'  =  LLTdu*'  =  a' du*'  .  (60'  ) 

which  appeared  already  in  (41a)  and  (50a). 

The  resolution  of  a  system  can  proceed  along  different  avenues.  For 
example.  If  the  uxu"  elements  of  the  matrix  T*  were  given  and  fixed,  both  L  and 
T  would  be  determined  with  the  final  validity  by  (55).  This  illustrates  the 
fact  that  In  addition  to  the  fixed  matrix  L*,  the  determination  of  a  system 
requires  the  knowledge,  or  choice,  of  uxu”  independent  elements.  We  shall 
proceed  by  dividing  uxu"  elements  subject  to  choice  into  two  separate  groups  of 
u"xu"  and  u'xu"  elements,  respectively.  Since  only  the  second  group  will  play  a 
role  in  the  determination  of  L  and  thus  of  a'  and  du'  from  (59)  and  (60),  the 
analysis  based  on  the  properties  of  a'  and/or  du'  will  be  greatly  facilitated. 
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In  order  to  describe  a  family  of  systems,  we  shall  choose  one  member  of  the 


family  as  initial  and  then  consider  its  variants  as  has  been  suggested  in  the 
preceding  section.  However,  simultaneous  variations  will  apply  only  to  the 
matrices  I.  and  T*  .  Whereas  the  matrix  L*  is  considered  fixed  from  the 
beginning,  the  matrix  T  can  be  fixed  in  one  "loop"  of  a  nested  approach  leading 
to  a  sub  family  of  systems.  This  process  can  be  imagined  repeated  with  all 
allowable  matrices  T,  eventually  describing  the  entire  family  of  systems 
consisting  of  the  fixed  matrix  L*  and  of  the  matrix  families  of  T,  L,  and  T* . 

The  family  of  L  will  be  shown  independent  of  the  variations  in  T,  which  will 
enable  us  to  accomplish  the  analysis  dealing  with  du'  and  a'  without  the  nesting 
process.  The  matrix  T  is  seen  below  to  become  fixed  as  soon  as  u"*u"  of  its 
elements  grouped  in  T"  are  chosen  and  held  fixed.  These  elements  comprise,  in 
fact,  the  first  group  of  elements  subject  to  choice  alluded  to  at  the  close  of 
Sect  ion  5.1. 

To  determine  a  general  matrix  T.  we  use  (54b)  with  partitioned  L*  and  T, 
where  the  former  has  been  presented  explicitly  in  (57).  This  yields  T'=-RT", 
and  thus 

T  -  [  RT  I ]T T"  .  (62) 

The  submatrix  T"  must  be  regular  due  to  the  full  column  rank  of  T,  but  otherwise 
can  be  arbitrary.  Its  elements,  and  thus  also  the  entire  matrix  T,  are  now 
considered  fixed. 

The  symbols  L  and  T*  henceforth  refer  to  the  respective  families  of 
matrices,  while  their  initial  choices  are  underlined.  We  thus  have 

I.  L  ►  AL  ,  (63) 

T*  =  T*  ♦  AT*  ,  (64) 

where  M, .  and  AT*  symbolize  the  variants  of  the  initial  choices.  The? 
complete  family  of  T*  can  be  described  only  after  all  allowable  submatrices  T" 
in  (62)  have  been  accounted  for,  whereas  the  family  of  I.  is  independent  of  such 
variations.  This  will  become  apparent  upon  considering  the  basic  conditions 
(54a  d),  which  must  be  fulfilled  by  the  initial  system  as  well  as  any  of  its 
var iants . 
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Particularly  simple  and  useful  choices  for  L  and  T*  can  be  made  in  terms  of 
the  fixed  matrices  L*  and  T,  respectively,  as  follows: 

L  -  I.*  (I.*TL* )  1  ,  (65) 

T*  -  T (TTT)  1  .  (66) 

It  is  readily  confirmed  that  with  these  initial  matrices  the  conditions  (54a  d) 
are  satisfied  A  valid  initial  system  has  thus  been  established.  As  will  be 
explained,  this  system  can  also  be  called  canonical  due  to  the  advantage  offered 
by  the  form  of  L  and  T*  above. 

We  next  proceed  to  determine  the  family  of  systems  by  applying  the 
conditions  (54a.c,d);  the  condition  (54b)  is  fulfilled  by  (62)  with  any  regular 
submatrix  T"  and  need  not  be  mentioned  again.  We  shall  formulate  these 
conditions  with  (63)  and  (64)  for  L  and  T* ,  utilizing  the  fact  that  they  are 
already  fulfilled  with  L  and  T*  .  Prom  (54a, c,d)  we  obtain,  respectively, 


L*  AL  -  0  , 

T*TAL  +  AT*TL  v  AT*TAL  «  0  , 


(67a) 


(67b) 


AT*  T  -  0 


The  matrices  AL  and  AT*  are  partitioned  in  the  same  fashion  as  their 
counterparts  L  and  T*  presented  past  equation  (56).  Upon  considering  (57), 
equation  (67a)  gives 

AL  -  [  KT  I]TAL”  s  T(T")'1AL"  ,  (68) 

where  the  last  formulation  follows  from  (62).  On  the  other  hand,  (67c)  results 
in  AT*=L*(L*')  ' AT* ' ,  where  the  partitioned  form  of  L*  from  (57)  as  well  as 
the  equality  T'-  RT”  from  (62)  have  been  taken  into  account.  Since  (67b)  leads 
to  AT* ’ =-L* 1 AL"^(T"  )  we  obtain 

AT*  -  -L*AL"”  (T"1)  1  .  (69) 

From  (68),  including  the  last  formulation  where  T(T")  5  is  fixed  throughout,  we 
observe  that  AL  depends  only  on  the  u'xu"  elements  of  AL" ,  which  constitute 
the  second  group  of  elements  subject  to  choice  as  mentioned  at  the  close  of 
Section  5.1.  it  thus  follows  from  (65)  and  (68)  that  L  varies  only  with  the 
completely  arbitrary  submatrix  AL" ,  and  is  independent  of  T" .  By  contrast,  T* 
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varies  with  both  AL"  and  T".  This  is  evidenced  by  (66)  with  (62)  showing  the 
dependence  of  T*  on  T" .  and  by  (69)  showing  the  dependence  of  AT*  on  T"  as 
well  as  on  AL" . 

We  notice  that  (67a)  alone  leads  to  other  useful  identities.  For  example, 

T 

due  to  the  decomposition  A=FL*  in  (13a),  equation  (67a)  Implies  that 

AAL  =  0  .  (70) 

The  latter  part  of  Section  2.4  indicates  that  a  relation  similar  to  (13a)  can  be 

written  in  conjunction  with  the  functional  space,  in  which  case  A  and  F  are 

T 

attributed  the  symbol  '.  But  since  L*  remains  unchanged,  (67a)  also  yields 

AAL  =  0  .  (70’ ) 

The  identity  (70)  enables  us  to  confirm,  via  the  matrix  family  of  L,  the 
uniqueness  of  y  previously  demonstrated  via  geometry.  In  particular.  If  we 
substitute  I,  from  (63)  into  the  formula  for  y  in  (61),  equation  (70)  shows  that 
the  term  containing  AL  is  zero,  so  that 

y  -  LTdu*'  ’  LTATg*dx  .  (71) 

Thus,  no  matter  which  member  of  the  family  L  is  used  in  the  computation,  y  is 
unique  and  is  expressed  with  advantage  through  L. 

The  usefulness  of  the  Initial  system  adopted  in  this  study  can  best  be 

T 

illustrated  by  means  of  the  additional  identities  below.  Due  to  L*  T=0  and  the 
definition  of  L  and  T* ,  it  follows  that 

LTT  =  0  ,  T*PL*  =  0  .  (72a, b) 

These  equations  are  valid  with  any  T",  but  strictly  with  L  and  T*  (i.e., 

AL"  0).  Furthermore,  In  consulting  (68)  and  (69),  we  deduce  that 

LTAL  0  .  T*TAT  =  0  ,  (73a ,  b ) 

which  are  seen  to  hold  true  independent  of  AL"  and  T" .  The  property  (73a) 

T 

will  greatly  facilitate  the  analysis  of  a  family  of  expressions  such  as  L  L, 

T  T 

reducing  it  to  the  initial  product  L  L  plus  the  family  of  AL  AL.  The 
vanishing  of  cross  products  such  as  seen  above  is  a  trademark  of  canonical 
systems  in  various  mathematical  problems.  In  this  sense,  the  special  initial 
system  used  in  the  present  analysis  19  canonical. 
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Next,  we  develop  an  explicit  form  for  the  families  of  1,  and  T* ,  similar  to 

the  expressions  (57)  and  (62)  for  L*  and  T  We  begin  with  L.  whose  formation  in 

(65)  entails  an  Inversion  of  two  positive  definite  matrices  of  dimensions 

(u'xii1),  the  first  being  N  needed  in  the  computation  of  R  and  subsequently  1* , 

T  11 

and  the  second  being  L*  L*.  However,  the  latter  can  be  replaced  by  an  inversion 
of  another  positive  definite  matrix  whose  dimensions  are  |u"»u"|.  Since  in 
practice  u"<u',  this  avenue  holds  an  economical  advantage.  We  now  formulate  L 
from  (65)  in  conjunction  with  (57): 

L  -  [I  R]T(I  ♦  RRT)  1  (b*|T)  1  .  (74) 

T 

where  the  positive  definite  matrix  1+RR  has  the  dimensions  ( u ' * u '  )  .  To  develop 
an  equivalent  but  more  useful  expression,  wo  first  write  the  identity 

T  TIT  T 

R  =  (I  +  R  R)  R  (I  *-  RR  )  .  (75a) 

Upon  premultiplying  (75a)  by  R,  adding  I  to  both  sides,  and  postmultlplying  the 

T  -1 

new  equation  by  (I  *  RR  )  one  obtains  (75b)  below.  And  upon  postmultlplying 
T  1 

(75a)  by  (I+RR  )  one  obtains  (75c).  The  two  generated  identities  read 

(I  *■  RRT)  1  =  I  -  R  ( I  ♦  RTR)  !RT  ,  (75b) 

T  T  -1  TIT 

R  (I  -  RR  )  =  (I  ♦  R  R)  R  .  (75c) 

We  now  introduce  the  notation  H  for  the  following  matrix  expression,  needed 
in  reformulating  L  as  well  as  T* : 

H  --  [  RT  I  ]T(  1  +  RTR)  1  ,  (76) 

T 

where  the  positive  definite  matrix  I+-R  R  has  the  dimensions  (u'xu  )  as 
stipulated.  With  the  identities  (75b, c),  the  matrix  L  from  (74)  becomes 

L  =  {  (I  0]T  .  HRT) (L*,T)  1  .  (77) 

The  family  of  matrices  AL  has  been  presented  in  (68)  and  need  not  lie  repeated 
The  new  explicit  formulation  of  the  family  of  I,  then  follows  from  (63)  as 

I,  --  ((I  0|T  +  HRT)(I.*'T)  1  M  RT  I)TA1,"  ,  (78) 

where  only  A[,"  is  variaiiie.  Wc*  reiterate  that  the  u'xu"  elements  of  t  hi  s 
submatrix  are  completely  arbitrary. 

4  1 


With  regard  to  T* ,  equations  (62)  and  (66)  yield 

T*  H ( T " r )  '  (79) 

The  family  of  matrices  AT*  has  been  presented  m  (69)  The  new  explicit 
formulation  of  the  family  of  T*  then  follows  from  (64)  as 

T*  (M  L*  AL"T  )  (T'"T)  1  ,  (80) 

featuring  not  only  AI."  but  also  T"  as  variable.  We  reiterate  that  the  u"*u" 
elements  of  the  latter  are  arbitrary,  subject  only  to  the  restriction  that  T" 
must  tie  regular. 

Equation  (80)  illustrates  how  the  nested  approach  can  be  used  in  theory  to 
desi  rlbe  the  family  of  T*  In  a  natural  sequence,  one  first  chooses  a  regular 
matrix  T"  and  holds  it  fixed  while  varying  AL"  over  its  range.  The  second  and 
subsequent  steps  differ  from  the  above  only  in  a  changed  T" ,  until  the  latter 
has  covered  its  entire  range.  However,  to  select  a  unique  system  of  the  family, 
one  only  needs  to  choose  one  submatrix  T"  and  one  submatrix  AL” ,  and  use  them 
in  (62)  giving  T  in  terms  of  T" ,  in  (78)  giving  L  in  terms  of  AL" ,  and  in  (80) 
giving  T*  in  terms  of  both  T"  and  AL" . 

In  considering  that  the  goals  of  the  present  analysis  are  Intimately  linked 
to  t  tie  i  dial  acter  ist  ics  of  du '  and  a',  it  is  expedient  to  concentrate  on  a  sub 
family  of  systems  corresponding  to  a  desirable  sub  family  of  L.  The  hierarchy 
in  the  treatment  of  elements  subject  to  choice  can  then  be  altered  accordingly, 
based  on  a  selected  submatrix  AL"  rather  than  T" .  This  submatrix  yields  a 
unique  matrix  L  from  (78),  while  the  matrix  T  from  (62)  and  the  matrix  T*  from 
(80)  are  non  unique,  depending  on  T  which  is  now  variable.  Clearly,  each  pair 
of  T  and  T*  must  use  t he  same  T" .  At  this  stage  not  only  L,  hut  also  du'  and  a' 
remain  unique,  unaffected  by  the  variability  in  the  elements  of  T"  Hut 
regardless  of  the  hierarchy  in  the  variable  elements,  for  every  one  choice  of 
AL"  and  T" ,  the  conditions  (54a  d)  are  satisfied  and  the  four  matrices  I.*,  L, 

T*.  and  T  contain  a  valid  set  of  parametric  space  components  of  the  orthonormal 
vectors  8  .  j . t,  ... 


K 


IK 

« 
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5  3  Families  of  Adjustment  Quantities 


As  tins  been  indicated  in  the  latter  part  of  Section  5  1,  the  matrix  family 
ot  1.  plays  an  essential  role  in  the  determi nat ion  of  the  adjustment  quantities 
a  and  du’  The  description  of  L  via  the  initial  choice  L  and  its  variants  AL 
leads  to  tiie  description  of  these  quantities  along  similar  lines  A  subsequent 
analysis  is  greatly  facilitated  by  the  canonical  property  of  the  initial  choice. 
However,  the  adjustment  quantities  such  as  dx 1  and  g'  are  Independent  of  the 
parametrii  space  components,  which  have  been  eliminated  by  tensor  contractions. 
As  geometrical  considerations  have  already  indicated,  these  quantities  are 
unique  and  must  therefore  be  obtainable  w  i  t  ii  any  choice  of  1,.  Tfiis  will  be 
confirmed  by  showing  that  the  terms  containing  Al.  vanish,  similar  to  the 
discussion  concerned  with  y  In  the  preceding  section. 

The  family  of  a'  is  described  by  (59)  together  with  (63)  In  a 
straightforward  fashion  as 

a  a'  *  ALALT  *  LA1.T  *  ALL7  .  (81) 

where 

a'  LI,1  .  (82) 

T 

liquation  (81)  cannot  be  simplified  because  in  general  LAL  *0.  However,  the 

T 

trace  of  the  latter  is  equal  to  the  trace  of  L  AL,  which  is  zero  by  virtue  of 
the  canonical  initial  system  as  evidenced  by  (73a).  In  terms  of  traces,  wc  thus 
ha  ve 

Tr(a’)  Tr(a')  *  Tr(ALALT)  .  (83) 

T 

The  first  term  on  the  right  hand  side  ran  also  be  written  as  Tr(L  L),  which  is 

T  1  T 

Tr((l.*  (.*)  |.  arid  the  second  term  can  also  he  written  as  Tr(AL  Al, ) 

File  family  of  du '  is  described  by  (60)  together  with  (63)  as 

i('i '  du  '•  •'(.  y  .  ( 8.]  ) 

whe  re 

du'  Ly  .  (85) 

The  most  convenient  form  of  the  column  vector  y  has  been  presented  in  (71) 
Equation  ( H S )  ran  thus  be  written  as 

<3  t 


du 


L  L  r  du* ' 


a  '  du*  '  , 


(85’  ) 


which  corresponds  to  the  canonical  member  of  (60').  Finally,  in  describing  the 
T 

family  of  du'  du',  we  again  take  advantage  of  (73a)  and  obtain 

du'Tdu'  -  du,Tdu'  ♦  (ALy)*(ALy)  .  (86) 

We  now  turn  to  the  adjustment  quantities  independent  of  the  parametrlc- 
space  components  and  confirm  their  uniqueness.  In  particular,  using  (70) 
together  with  (84)  we  deduce  that 

dx '  -  Adu'  =  Adu'  (87) 

Similarly,  (70)  in  conjunction  with  (81)  yields 

K '  A  a ' AT  =  Aa ' AT  (88) 

Thus,  no  matter  which  members  of  the  families  of  du'  and  a'  are  used  in  the 
computation,  dx'  and  g'  are  unique;  they  are  expressed  with  advantage  through 
the  canonical  members  du'  and  a',  respectively.  We  can  write  relations  similar 
to  (87)  and  (88)  in  conjunction  with  the  functional  space,  in  which  case  A,  dx ' , 
and  g'  are  attributed  the  symbol  The  uniqueness  of  parametric  functions  and 
their  variance -covariance  matrix  is  then  confirmed  via  (70'). 


5 . 4  Minimum -Trace  and  Minimum  Norm  Criteria 

We  first  examine  the  conditions  resulting  in  a  minimum  trace  of  the 

variance  covariance  matrix  of  the  parameters,  i.e.,  in  Tr (a ' ) =mi nimum .  The 

groundwork  for  this  task  has  been  laid  in  the  preceding  section,  where  (83) 

expresses  the  family  of  Tr(a')  in  terms  of  the  fixed  part  Tr(a')  and  the 

T 

variable  part  T r ( ALAL  ).  Since  the  latter  equals  the  sum  of  squares  of  all 
the  elements  in  AL ,  the  necessary  and  sufficient  condition  for  (83)  to  achieve 
a  minimum  is 


L  -  0  .  (89) 

Accordingly,  the  family  of  a'  in  (81)  reduces  to  a'  given  by  (82),  and  the 
family  of  du'  in  (84)  reduces  to  du'  given  by  (85)  or  (85').  We  recapitulate 
this  outcome  by  stating  that  the  minimum -trace  criterion  leads  to  the  resolution 
of  a'  and  du'  in  the  form 


44 


(90a) 


T 

a  -  LL 

du ’  =  Ly  «  a'du*'  ,  (90b) 

where  y  is  given  by  (71)  and  a  convenient  explicit  form  of  L  is  presented  in 
(77)  together  with  (76). 

The  nor*  of  the  parametrir  solution  du1  is  defined  by  the  square  root  of 
T 

the  product  du'  du'.  We  now  address  the  conditions  leading  to  a  minimum  norm  of 
T 

du'.  i.e.,  to  du'  du'=*inimum.  The  groundwork  for  this  task  has  also  been  laid 

T 

in  Section  5.3.  where  (86)  expresses  the  family  of  du1  du'  in  terms  of  the  fixed 
T  T 

part  du'  du'  and  the  variable  part  (ALy)  (ALy).  Since  the  latter  is  equal 
to  the  sum  of  squares  of  all  the  elements  in  the  vector  ALy.  the  necessary  and 
sufficient  condition  for  (86)  to  achieve  a  minimum  is 

ALy  =  0  .  (91 ) 

Clearly.  AL  0  alone  would  bring  about  this  minimum.  However,  such  a  condition 
is  sufficient  but  not  necessary.  It  would  become  also  necessary  if  (86)  should 
be  fulfilled  with  any  possible  y  and  thus  also  with  any  possible  observational 
vector  dx.  But  this  is  not  our  case,  where  only  one  vector  dx  is  part  of  the 
adjustment  model,  and  we  search  for  an  optimal  solution  within  this  model. 

In  considering  AL  from  (68),  we  conclude  that  (91)  is  satisfied  only  if 

AL" y  0  .  (91') 

We  now  partition  AL"  into  its  first  column  and  into  the  remaining  u'  1  columns 
forming  the  submatrix  AL^.  In  analogy  to  this,  the  (unique)  column  vector  y 
is  partitioned  into  its  first  element  a  and  into  the  remaining  u'-l  elements 
b,  ...  forming  the  vector  y^  It  is  assumed  that  a*0,  otherwise  a  different 
partition  would  take  place.  This  is  always  possible  unless  y  0.  which  would  tie 
o  trivial  case  where  du* '  0  and  du '  0  regardless  of  L  and  AL  With  the  above 
partitions.  (91)  yields 

AL"  =  ai.2(  (  1  /a )  y 2  1  |  .  (92) 

where  the  matrix  AL^  is  completely  arbitrary. 

With  (91)  satisfied.  It  is  clear  from  (84)  that  the  resolution  of  du'  is 
unique,  equal  to  du'  as  in  (90b)  However,  a'  is  not  unique,  although  it  is 
partially  restricted  by  (92),  where  only  the  matrix  AL^  of  dimensions 


u'x(u'-l)  is  arbitrary,  not  the  matrix  AL"  of  dimensions  u"xu'  as  in  the 
general  case.  In  view  of  (68)  and  (92),  the  partially  restricted  family  of  AL 
reads 

AL  -  [~RT  I ] T AL ^ [ -  (l/a)y2  1  ]  .  (93) 

The  outcome  for  a'  and  du'  is  recapitulated  as 

a'  -  LLT  ,  (94a) 

du'  -  Ly  =  a 1 du* ’  ,  (94b) 

where  the  family  of  L  is  written  as  L*AL  in  (63),  except  that  the  family  of 
AL  is  now  given  by  (93).  With  this  restriction  in  mind,  we  can  rewrite  the 
general  formulas  for  a'  and  Tr(a')  from  (81)  and  (83)  as  they  stand. 

Since  the  partially  restricted  family  of  AL  in  (93)  depends  on  the  data 
through  the  column  vector  y,  the  members  of  the  family  of  a'  in  (94a, b)  could  be 
called  "data  induced  inverses"  of  a*'.  Even  though  such  inverses  are  non¬ 
unique,  they  give  rise  to  the  unique  canonical  solution  du’  whose  norm  is  a 
minimum.  However,  unless  AL=0  characterizing  the  canonical  system  itself,  It 
is  apparent  from  (83)  that  the  trace  of  the  elements  in  each  matrix  of  the 
family  of  a"  is  larger  than  Tr(a'). 

In  principle,  the  minimum-norm  criterion  produces  a  unique  solution  and  a 
non  unique  variance-covariance  matrix  associated  with  it.  From  the  adjustment 
standpoint,  such  a  situation  is  unacceptable.  In  a  different  approach 
independent  of  data,  the  minimum-trace  criterion  results  in  the  unique  canonical 
solution  du'  and  the  unique  canonical  variance-covariance  matrix  a'  associated 
with  it.  The  column  vector  du'  has  the  minimum  norm  and  the  matrix  a'  has  the 
minimum  trace  These  characteristics,  coupled  with  the  relative  simplicity  and 
computational  efficiency  of  the  canonical  expressions,  make  the  minimum-trace 
criterion  a  preferred  tool  in  the  resolution  of  rank  deficient  models. 


6.  CONNECTIONS  AMONG  THE  FORMULATIONS 


6 • 1  Minimal-Constraint  Matrix 

Chapters  3  and  4  have  resolved  the  geometrical  setup  along  general  lines, 

and  have  transcribed  the  main  results  in  matrix  notations  to  facilitate  their 

comparison  with  standard  adjustment  formulas.  The  tensor  Q^,  which  played 

an  important  role  in  that  development,  has  been  transcribed  as  Q,  known  in 

adjustment  calculus  as  the  minimal -constraint  matrix.  The  geometrical 

development  has  resulted  in  a  non  unique  solution  du ’  and  a  non-unique 

variance-covariance  matrix  a'.  These  quantities  become  unique  if  Q  is  given 

explicitly  In  practice,  Q  is  sought  in  a  form  that  leads  to  desired  features 

-  T 

of  the  resolution.  It  is  well  known,  for  example,  that  if  AQ  ~0,  the  minimal- 
constraint  formulation  leads  to  the  smallest  possible  trace  of  a'.  We  shall 
confirm  this  and  other  properties  using  the  outcome  of  the  preceding  chapter. 

Various  resolution  criteria,  such  as  those  Involving  the  trace  of  a'  or  the 
norm  of  du',  are  linked  to  the  components  ta,  ja,  ...  and  thus  to  an  implicit 
parametric -space  coordinate  system.  These  criteria  cannot  be  represented 
graphically  (in  terms  of  tensor  invariants),  nor  expressed  in  tensor  equations, 
because  the  geometrical  configuration  as  well  as  the  pertinent  tensor  equations 
are  independent  of  any  coordinates.  One  is  therefore  compelled  to  analyze 
Individual  tensor  components  as  we  have  done  in  Chapter  5.  This  step  would  be 
unnecessary  in  the  full  rank  adjustment,  where  u"  0  and  no  components  of  the 
orthonormal  vectors  are  arbitrary. 

Chapter  5  has  shown  that  Q  Is  not  needed  if  the  adjustment  quantities  du ' 

and  a1  are  expressed  directly  through  the  parametric  space  components  of 

8,  j,  ...  ,  without  an  intermediary  such  as  the  extension  surface.  The  latter 

has  entered  the  development,  In  one  capacity  or  another,  in  both  Chapters  3 

and  4.  Although  this  surface  is  implicated  also  in  Chapter  5  through  the 

parametric-space  components  of  t .  its  role  could  have  ended  upon  obtaining 

an  expression  for  the  family  of  1,  needed  to  describe  thp  families  of  du '  and  a'. 

Such  a  limited  role  would  have  merely  confirmed  that  AL  in  (68).  based 
T 

entirely  on  (-*  LI  in  (54a),  is  valid.  However,  we  have  developed  also  the 
family  of  T*.  in  order  to  relate  the  analytical  formulation  in  Chapter  5  to  the 
formulations  in  Chapters  3  and  4  which  utilize  the  matrix  Q. 


Table  1  suggests  that  a  general  matrix  Q  can  be  presented  as 

Q  =  TT*T  ,  (95) 

where 

f  =  [ f  t AJ  ■ ■ •  )  .  (96) 

and  where  T*  appears  in  (80).  With  the  latter,  we  describe  the  family  of  Q  by 

Q  =  T  (T" )  1  (HT  -  AL"L*T)  ,  (95'  ) 

Chapter  5  has  shown  that  the  only  variable  elements  affecting  du'  and  a'  are 
those  grouped  in  AL".  We  can  thus  qualify  the  statement  at  the  close  of 
Chapter  3  by  stating  that  the  variability  in  du’  and  a'  caused  by  the 
variability  in  Q  is  due  to  AL"  but  not  to  T"  or  T. 

From  the  structure  of  Q  in  (95’)  it  is  clear  that  a  given  minimal 
constraint  matrix  of  dimensions  (u"xu)  can  be  premultiplied  by  any  regular 
matrix  and  the  result  is  again  a  valid  minimal -constraint  matrix.  Such  a  change 
in  Q  can  always  be  thought  of  as  absorbed  by  the  arbitrary  matrices  T  or  T" . 

The  latter  possibility  illustrates  another  important  fact,  namely  that  T  can 
vary  without  affecting  Q  because  T"  can  always  compensate  for  such  variations. 

In  relation  to  Chapter  3,  this  property  helps  us  to  verify  that  k*sk  1  can 
indeed  be  an  arbitrary  positive-definite  matrix  used  as  a  weight  matrix  in 
conjunction  with  a  given  Q.  Upon  writing 

k  =  TTT  (97) 

-T 

as  suggested  by  Table  1,  one  can  compute  T  ,  for  example,  by  the  Choleski 
algorithm  for  positive  definite  matrices.  Although  changes  in  k*  entail  changes 
in  T,  the  matrix  Q  can  be  kept  intact  by  virtue  of  the  arbitrariness  in  T" . 

Tn  tracing  such  variations  further,  we  realize  that  they  propagate  into  T*  and 

- 1  T 

thereby  into  a*".  (To  see  this  we  use  k*=k  in  40d  and  confirm  that  a*"-T*T*  , 

where  T*  is  affected  by  T"  in  the  manner  of  80.)  It  should  be  emphasized  that 

the  variations  described  in  this  paragraph  leave  du’  and  a'  intact. 

Tn  assessing  the  approaches  of  Chapters  35,  we  first  recall  that  du'  and 
a'  depend  on  the  arbitrary  matrix  AL"  either  through  L  or  through  Q.  The 
former  case,  presented  in  Chapter  5,  is  straightforward.  The  latter  case, 
presented  in  Chapters  3  and  4,  is  more  complex  due  to  the  introduction  of  Q 
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containing  the  additional  arbitrary  matrices  T  and  T" .  However,  these  two 
matrices  have  no  bearing  on  dn1  and  a'.  Prom  the  standpoint  of  this  study,  they 
serve  mainly  to  illustrate  that  the  standard  adjustment  formulations  using  Q 
are  quite  cumbersome  when  compared  to  the  analytical  formulation.  If  we  compare 
the  sizes  of  the  matrices  to  be  inverted,  an  economical  edge  of  the  analytical 
formulation  becomes  apparent  as  well.  Chapter  3  contains  one  such  matrix  of 
dimensions  (uxu),  where  u=u' *u".  Chapter  4  also  contains  one  matrix  to  be 
inverted,  but  its  dimensions  are  ( (u+u" )x (u+u" ) ] .  However,  Chapter  5  only  needs 
to  invert  one  matrix  of  dimensions  (u'xu1)  and  one  matrix  of  dimensions  (u"xu”). 

Perhaps  the  greatest  asset  of  the  analytical  formulation  is  the  simplicity 
of  its  theory.  In  keeping  the  geometrical  qualities  of  the  basic  matrices  in 
focus,  one  can  readily  generate  families  of  results  fulfilling  specific  criteria 
and  classify  them  according  to  the  u”xu'  arbitrary  elements  grouped  in  the 
matrix  AL".  Equivalent  results  could  be  obtained  using  Q  ,  but  this  would 
entail  differentiation  of  complex  matrix  expressions.  Such  an  approach,  besides 
being  more  tedious,  would  be  algebraic  in  nature.  It  has  been  avoided,  and  the 
outcome  of  Chapter  5  has  been  extended  to  benefit  also  the  formulations  in 
Chapters  3  and  4.  This  strategy  is  rooted  in  the  fact  that  a  given  matrix  AL" 
leads  to  the  same  results  regardless  of  the  methodology,  i.e.,  regardless  of 
whether  it  is  used  in  forming  I,  in  (78)  or  Q  in  (95'). 

These  results  are  now  briefly  summarized.  A  completely  arbitrary  AL" 
characterizes  a  general  resolution  represented  by  the  (unrestricted)  families  of 
du'  and  a’.  The  partially  restricted  AL"  from  (92)  characterizes  the  unique 
minimum  norm  solution  du '  and  a  partially  restricted  family  of  a'.  And  AL'^O 
characterizes  the  unique  minimum-norm  solution  du'  and  the  unique  minimum  trace 
variance  covariance  matrix  a'.  As  is  suggested  by  (95'),  in  the  last  case  the 
matrix  Q  simplifies  to  the  form  denoted  Q  and  called  canonical,  where 

Q  -  T ( T " )  1 HT  .  (98) 

The  matrices  T  and  T"  used  In  forming  Q  in  ail  three  categories  are  regular, 

'•it  otherwise  can  he  arbitrary.  In  terms  of  Chapter  3,  this  implies  that  the 

T 

variance  c nvar  i ance  matrix  k  TT  associated  with  the  minimal  constraints  can 
be  arbitrary  provided  it  is  positive  definite . 
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Finally,  we  make  a  connection  between  the  for*  of  Q  and  the  rank  of  the 


matrix  A  augmented  by  Q.  In  a  first  step,  using  any  member  of  the  family  of 
Q  presented  in  (95)  as 

Q  =  TT*T  ,  (99) 

we  show  that 


rank  _  =  u 

Q 


(100) 


which  is  (39b)  developed  in  Chapter  2  through  geometrical  considerations. 

Since  (99)  represents  a  straightforward  geometrical  relationship,  this  step 

reduces  to  a  confirmation  of  consistency  in  geometrical  derivations.  Recalling 

T 

from  (13a)  that  A=FL*  ,  we  write 


(101) 


The  first  matrix  on  the  right-hand  side  has  the  full  column  rank  u,  and  the 

second  matrix  is  regular.  Upon  postmultiplylng  (101)  by  [L  T]  and  recalling  the 

T  ~T  T 

identity  (55),  the  product  [A  Q  ]  (L  T]  is  seen  to  have  the  full  column  rank 
u,  hence  (100)  is  necessarily  true. 

As  an  important  special  case  of  (99),  we  consider  the  canonical  system 
synonymous  with  the  minimum  trace  property.  Thus,  Q  is  restricted  to  the 
special  case  seen  in  the  explicit  form  in  (98),  written  in  analogy  to  (99)  as 

Q  =  T T*T  .  (99' ) 

(The  term  "case"  is  used  here  loosely,  reflecting  the  fact  that  AI,"-0;  we  know 
that  T  and  T"  can  be  arbitrary,  but  these  matrices  hold  little  interest  at. 
this  stage.)  Upon  using  (13a)  for  A  in  conjunction  with  the  identity  (72b),  it 
follows  from  (99')  that 


AQ  =  0  , 


( 100'  ) 


which  constitutes  a  special  case  of  (100). 


In  including  also  a  c  werse  demonstration,  we  further  show  that  (100) 


1 eads  to  ( 99  )  .  In  this 


ess  the  symbol  G  is  used  in  place  of  Q.  Since  it 


must  hold  that  rank(G) 


the  matrix  G  can  be  decomposed  into  the  product 
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where  G Js  regular  and  has  the  full  row  rank  u".  The  matrix  can  be 

considered  arbitrary,  but  if  G  is  fixed  then  any  one  choice  of  settles  . 

Recalling  again  (13a)  for  A.  we  can  write  a  relation  similar  to  (101),  except 

T 

that  T  is  replaced  by  G^  and  T*  is  replaced  by  Since  the  matrix  on  the 

left-hand  side  of  this  new  equation  has  the  full  column  rank  u  by  definition, 

T  T 

the  matrix  (L*  G  ]  on  the  right  hand  side  must  be  regular.  But  then  G  can 

*  j 

represent  an  admissible  matrix  T*  (which,  in  turn,  settles  I,  and  T).  Since  we 

can  further  identify  G  with  the  arbitrary  regular  matrix  T,  we  can  write 
T  ^ 

G=TT*  for  any  matrix  G  satisfying  the  initial  rank  stipulation.  Accordingly, 
any  admissible  matrix  G  has  the  structure  of  Q  in  (99),  and  the  demonstration 
is  terminated. 

As  a  special  case  in  the  converse  demonstration,  we  wish  to  proceed  from 

(100')  to  (99')  using  the  same  notations  and  basic  steps.  We  thus  begin  with 
T 

AG  =0,  representing  a  special  case  of  the  initial  rank  stipulation.  Next,  we 

replace  A  by  FL*T  according  to  (I3a).  Since  the  rank  of  F  is  u'  it  follows  that 
T  T  T  T 

L*  G  =0,  hence  L*  G2=0,  which  is  similarly  a  special  case  showing  that  the 

matrix  [L*  gJ)T  is  regular.  But  from  (72b)  it  follows  that  the  admissible  T*T 

represented  by  G2  must  be  T*  ,  so  that  we  can  write  G-TT*  completing  the 

demonstration.  We  have  thus  established  that  in  the  approaches  utilizing  the 

-T 

matrix  Q,  the  minimum  trace  criterion  is  satisfied  only  if  AQ  0.  This 
occurs  only  for  Q=Q,  whose  explicit  form  is  given  by  (98).  In  practice, 
such  a  matrix  is  usually  easy  to  obtain  from  the  structure  of  the  adjustment 


6 . 2  Confirmation  of  Consistency 


In  this  section,  we  shall  verify  that  the  results  for  du1  and  a’  are  the 
same  in  all  three  formulations  described  by  Chapters  35.  For  its  simplicity, 
the  standard  of  comparison  is  adopted  from  Section  5.1  in  the  form  of  equations 
(60),  (59),  and  (61),  respectively: 

du'  --  Ly  ,  a'  =  LLT  ,  (102a, b) 

where  the  fixed  column  vector  is 

y  =  LTdu*'  .  (102c) 

Equations  (102a,b)  are  general,  not  subject  to  any  criteria  such  as  those 
analyzed  in  the  latter  part  of  Chapter  5.  They  are  also  the  most 
straightforward  expressions  offered  by  the  geometrical  setup  for  du1  and  a'. 

The  general  results  for  du '  and  a'  derived  in  Chapter  3  appear  in  (41a, b), 
rewritten  here  as 

du’  adu*'  ,  a'  •-  a  a* 'a  .  (103a,b) 

The  matrix  a  Is  given  by  (42),  which  reads 

a  =  (a*)  1  .  (103c) 

The  matrix  a*  is  formed  as  in  (40b-d),  namely 

a*  -  a*’  +  a*”  ,  a*’  A?g* A  ,  a*"  =  QTk*Q  .  (103d, e.f) 

All  of  (103a-f)  follow  from  the  geometrical  setup  developed  In  the  context  of 
the  universal  space. 

Finally,  the  general  results  for  du'  and  a'  derived  in  Chapter  1  can  be 
read  from  (49),  already  confirming  (102a. b)  However,  this  confirmation  is 
achieved  through  the  matrix  Q,  which  we  shall  not  consider  as  a  whole,  but, 
rather,  in  terms  of  the  basic  matrices  T  and  T*  (The  same  applies  for  Q  in 
the  last  paragraph.)  Thus,  we  begin  with  equation  (48),  rewritten  in  the  form 

rdu  a* '  Q^"1  ^  du* 

Ldw*j  Q 


M 


0 


0 


(104) 


After  the  indicated  inversion,  the  matrix  a'  will  occupy  the  location  of  a*'. 
Equation  (104)  is  a  consequence  of  the  geometrical  setup  developed  in  terms  of 
an  extension  surface  vector  restricted  to  zero. 

Since  all  of  (102a)- (104)  reflect  the  same  geometrical  setup,  the  results 
for  du'  and  a'  must  be  identical.  Although  this  is  not  readily  apparent,  we 
should  be  able  to  confirm  it  using  known  geometrical  relations  among  the 
orthonormal  vectors  t,  j,  ...  ,  t,  ...  The  parametric-space  components  of  these 
vectors  have  been  grouped  in  the  matrices  L* ,  I.,  T* ,  and  T  forming  a  general 
system.  Accordingly,  the  known  geometrical  relations  just  mentioned  are 
expressed  by  (53),  or  (54a-d),  or  (55),  which  are  all  equivalent.  However,  the 
presence  of  Q  requires  the  use  of  two  additional  matrices,  denoted  T  and 
T* ,  which  contain  the  extension  surface  components  of  t,  ...  The  former  has 
been  presented  in  (96),  while  the  latter  is  similarly  defined  as 

T*  -  [ (t A]  ...  ]  .  (105) 

We  now  list  the  geometrical  identities  which  will  be  used  in  relating  the 
results  of  Chapters  3  and  4  to  those  of  Chapter  5.  From  Table  1  we  read 

a*'  =  L*L#1  ,  a*"  =  T*T*T  ;  (106a, b) 

Q  =  TT*T  .  (107) 

Equations  (106a, b)  also  follow  from  (103e,f)  upon  using  the  decomposition  of  A 

and  Q  (the  latter  equation  further  uses  k*-k  1  with  k  given  in  97).  Although 

all  three  identities  have  already  been  encountered,  they  are  listed  here  for  an 

T- 

easy  reference.  The  definitions  (96)  and  (105)  imply  the  identity  T*  T-I, 
and  thus 

T*T  =  f  1  .  (W8) 

Finally,  due  to  the  orthogonality  of  any  vectors  in  the  extension  surface  with 
respect  to  any  vectors  in  the  model  surface,  we  have  as  a  special  case: 

Trill*  '  -  0  .  (  109  ) 

This  Identity  also  follows  from  (40e).  (13a),  and  (54b). 


In  turning  to  the  outcome  ot  Chapter  3  as  presented  in  (103a  f),  we  write 


a*  (L*  T*](L*  T*jT  ■  a  =  [I,  T  ]  ( I.  T]T  .  (110a, b) 

where  (110a)  follows  from  (103d)  and  (106a, b),  while  (1 10b)  follows  from  (103c) 
and  (55),  Both  identities  can  also  be  deduced  from  Table  1.  I f  we  substitute 
(110b)  in  (103a)  and  use  (102c)  and  (109),  we  confirm  the  result  (102a).  And  if 
we  substitute  (106a)  with  (110b)  in  (103b),  we  confirm  (102b)  as  well. 


The  confirmation  of  the  outcome  from  Chapter  4  is  lengthier  and  more 
complex.  First,  we  form  the  matrix  to  be  inverted  in  (104)  as 

'r'  rL*  T*  0  I  r  I,*  0  T* "j T 

0  T  T  [  |  0  T  T 


I 


0 


(111) 


J 


which  can  be  verified  upon  using  (106a)  and  (107).  Next,  we  invert  the  matrices 
on  the  right  hand  side  as  follows; 


(112a) 


IL* 

0 

T*: 

[T 

l 

1 

T  T‘ 

L° 

T 

-T  J 

/ 

L° 

T*  0 

T* 

°T 

-  1 

[L  T 

-t!t 

L° 


T* 


(112b) 


where  (112a)  can  be  verified  via  (54a  d),  and  (112b)  can  be  verified  via  (53). 


If  we  multiply  together  the  light  hand  sides  of  (112a, b)  in  the  same  order, 
we  obtain  the  inverse  of  the  matrix  on  the  left  hand  side  of  (111).  The 
substitution  of  the  latter  in  (104)  yields 


Fdu  ’1  [LI,7  Tt*  *  "1  j"  du*  ’"i 

Ldw*j  ‘  lt*tT  0  J  L  0  j 


(113) 


In  considering  (102c),  the  first  equation  implied  by  (113)  confirms  (102a). 

Moreover,  with  (109)  taken  into  account,  the  second  equation  yields  dw*  0 .  In 

agreement  with  the  statement  following  (104),  the  location  of  a'  in  (113)  is 
T 

occupied  by  LI,  ,  which  confirms  also  (!02b)  Upon  further  scrutiny,  (113)  is 
seen  to  be  identical  to  (49)  due  to  the  identity 

A  TT*T  ,  (114) 

which  can  be  read  directly  from  Table  1  This  concludes  the  task  of  verifying 
the  consistency  among  the  results  of  Chapters  3  5. 


7.  DISCUSSION 


7 . 1  Completeness  of  Adjustment  Fawllies 

The  method  suggested  in  Section  5.1  for  the  computation  of  L*'  from  N  has 
been  the  Choieski  algorithm  for  positive  definite  matrices.  Subsequently,  the 
matrix  L*  in  (57)  has  been  assumed  fixed  during  the  development  leading  to  the 
description  of  adjustment  families  in  Section  5.3.  We  shall  now  show  that  any 
method  used  in  the  computation  of  L* ’  results  in  the  same  adjustment  families  of 
du'  and  a’,  which  are  thus  complete  regardless  of  the  numerical  values  in  L*'. 
The  only  admissibility  condition  for  L* '  is 

L*1  L*'T  =  N  ,  (115) 

which  has  also  been  at  the  root  of  the  Choieski  choice  in  Section  5.1.  Since 
N  is  given  and  thus  fixed,  the  matrix  R  defined  in  (58)  is  fixed  throughout, 
i.e..  independent  of  L* ’ .  The  geometrical  relations  leading  to  (61)  have 
revealed  that  the  column  vector  y  is  fixed  as  well.  Furthermore,  in  consulting 
(68),  we  realize  that  although  AI,  is  variable  as  a  function  of  AL" ,  it  is 
fixed  with  respect  to  L* '  . 

On  the  other  hand,  L  and  thus  also  L  depend  on  L* 1 ,  as  is  clear  from  (74) 
or  (77)  and  from  (78).  However,  if  we  form  a1  by  (82)  in  conjunction  with  (74). 
we  obtain 

a  1  bbT  =  [I  R]T(I  *  RRT)  *  Nj  J  ( I  R  RT )  1  f  I  R]  , 
where  (115)  has  been  taken  into  account.  Moreover,  in  rewriting  ( 85 1 )  as 

du 1  -  a  1 du*  '  . 

where  du* '  is  given  and  thus  fixed,  we  conclude  that  both  du'  and  a'  are  fixed. 
Accordingly.  (83)  and  (86)  indicate  that  the  trace  of  a'  and  the  norm  of  du '  are 
independent  of  I,*',  although  the  same  cannot  be  said  of  the  families  of  a'  and 
du1  themselves  Hut  if  one  can  show  that  the  family  of  a'  is  independent  of 
I.*',  the  same  will  be  true  for  the  family  of  du’  by  virtue  of  (60'). 

The  family  of  a'  is  given  by  (81),  where  the  first  two  terms  on  the  right 

hand  side  are  independent  of  I,*’.  Since  the  third  and  the  fourth  terms  are 

T 

transposes  of  each  other,  all  we  need  to  show  is  that  LAI,  is  independent  of 
1,*  We  begin  by  assuming  the  existence  of  two  distinct  families  of  I,  L*AI, 


The  first  corresponds  to  the  ('holeski  choice  and  Is  called  "l",  and  the  second 


corresponds  to  a  different  admissible  choice  and  is  called  "J".  Based  on  (115) 


it  must  hold  that 


T  T 

’  i  *  1  ^  r  *  1  r  *  1 


L*’  L* 
1  l 


(116a) 


where  L* 1  is  the  submatrix  I.*’  as  evaluated  in  the  family  i,  etc.  Next  we 
i 


postulate  the  following  admissible  relationship  between  the  unrestricted 


submatrices  AL7  and  AL": 

i  J 


AL'j  =  AL^L*' 


( ’16b) 


since  both  (.*'  and  L* '  are  regular,  any  AL'.'  can  be  written  as 
i  J 


Al. ■;  =  AL':  (L*'  )  L*'  . 

J  i  i  J 


where  the  first  submatrix  exists  (in  fact,  it  can  be  computed  by  116b). 


As  a  matter  of  interest,  we  form  ALAI,  for  the  family  j,  where  AL  is 


given  by  (68)  with  AL"  attributed  the  subscript  j.  In  taking  advantage  of 


(116b)  and  then  of  (116a),  we  arrive  at  ALAI,  for  the  family  i.  This 


outcome  is  obtained  with  any  possible  AL (  in  conjunction  with  a  given  L* ' 


and,  upon  repeating  the  procedure,  in  conjunction  with  any  admissible  L*' 

T  J 

This  indicates  that  the  family  i  for  U,AI,  is  indeed  complete.  Since  the 


derivation  could  be  retraced  with  "i"  and  "j"  interchanged,  it  follows  that  any 


admissible  I,*1  leads  to  the  same  (complete)  family  of  ALAI,  .  Essentially 


the  same  conclusion  has  been  reached  earlier,  when  Al,  has  been  shown  to  be 


i  ndependent  of  1,*  '  . 


The  crucial  step  in  the  current  demonstration  proceeds  in  analogy  to  the 


previous  paragraph,  but  is  simpler  in  that  it  does  not  necessitate  the  identity 


116a)  We  form  LAI,  foe  the  family  j,  where  both  the  submatrix  I.*’  in  (74) 


or  (77)  and  the  suhmafrix  Al,'  in  (68)  are  attributed  the  subscript  j  Keeping 


L  intact  while  taking  advantage  of  (il6h),  we  arrive  at  LAI,  for  the  family  i 


An  argument  similar  to  the  one  above  leads  to  the  conclusion  that  the  family  i 


for  LAI,  is  complete,  and  that  the  same  family  can  tie  obtained  with  any 


admissible  I." 


This  concludes  the  proof  that  the  families  of  du'  and  a'  are 


independent  of  (,*’.  in  that  the  same  (complete)  families  are  obtained  with 


any  I*  fulfilling  (115)  One  ran  thus  adopt  the  (holeski  choice  and  consider 


I.*'  and  thereby  L*  f  1  xed  throughout  .  as  iias  been  anticipated  in  Section  5.1 


V\V\V X'.’  V-.'V  '  v 

JV  JjL  A  JV  i. 


>■  r’ 


7 . 2  Uniqueness  of  the  Canonical  Propert 


The  property  central  to  the  analysis  of  adjustment  quantities  in  Chapter  5 
has  been  embodied  by  (73a)  holding  identically  with  any  admissible  AL,  namely 

i/ai.  0  .  (117) 

As  we  have  seen  in  Section  5.2,  any  matrix  L  can  be  expressed  by  I.-L+AL,  where 
the  first  member  is  defined  in  (65)  and  the  second  member  appears  in  (68). 
Suppose  now  that  L  is  riot  the  only  matrix  fulfilling  (117)  and  denote  another 
such  matrix  as  I.,  where 

L  -  L  *  A  L  .  (118) 

Since  L  is  a  matrix  from  the  family  of  L,  AI_,  must  be  expressible  by  (68), 
i.e.,  it  must  have  the  form 

T  T 

AL  (  R  I  ]  AL"  . 

T 

If  it  should  hold  that  L  AL=0  for  any  admissible  AL,  in  considering 

(118)  together  with  (117)  we  would  have 

T 

AI/AL  =  0  . 

where  AL  has  the  form  (68).  This  relation  can  thus  be  written  explicitly  as 

AL"T(I  *  RTR)AL"  =  0  .  (119) 

where  the  submat  rix  AL"  of  dimensions  (u"*u'  )  is  completely  arbitrary,  and 

the  submatrix  AL"  of  the  same  dimensions  is  to  be  determined.  In  t hr*  usual 

situation,  when-  u’>u",  AL"  can  be  thought  of  as  partitioned  into  a  (u"xu") 

submatrix  and  the  remaining  submatrix.  Since  the  former  can  be  assumed 

T 

nonsingular,  and  since  the  matrix  (1*R  R)  is  positive  definite,  it  follows  from 

( 119)  that  we  must  have  AL"  U.  hence 

AL  0  (1 20 1 

For  the  sake  of  completeness,  we  also  consider  the  unlikely  case  u'<u". 
Since  11191  must  be  satisfied  with  any  AL".  the  net  effect  is  the  same  as  if 
it  had  to  hold  with  all  such  submatrices  simultaneously,  i.e.,  as  if  the  columns 
of  '.!.  were  augmented  by  the-  columns  of  all  the  other  suhmat  rices  Al."  One' 

•an  *  fien  always  <  house  u"  independent  columns  from  their  totality,  and  form  a 


regular  matrix  In  so  doing,  one  arrives  at  the  iast  step  in  the  preceding 
paragraph,  including  the  result  (120)  We  can  thus  conclude  that  the  matrix  L 
fulfilling  (117)  is  unique,  defined  by  (65)  and  developed  into  (74)  and  further 
into  (77).  Indeed,  this  is  the  matrix  we  would  obtain  if  we  started  from  the 
eond i t ion  (117) 


7.3  Canonical  System  and  the  Pseudoinverse 
♦ 

The  unique  pseudoinverse  M  of  the  matrix  M  fulfills  four  conditions, 

-f 

called  "8",  "g" ,  "r",  and  "m" .  The  condition  "t"  states  that  the  matrix  MM  is 

f  +  ♦  + 

symmetric,  "g"  states  that  MM  MM,  "r  states  that  M  MM  =M  ,  and  "m"  states  that 

*  T 

M  M  is  symmetric.  In  the  present  context,  the  role  of  M  is  played  by  L*  .  In 

T 

considering  L*  L=  I  from  (54a),  we  observe  that  the  condition  "£"  for  L  as  a 

T 

potential  pseudo  1 nverse  of  1,*  is  satisfied.  The  consequence  of  this  special 

form  of  "4"  is  an  automatic  fulfillment  of  the  conditions  "g"  and  "r"  as  well. 

T 

On  the  other  hand,  LI,*  is  symmetric  only  if  1,  L.  In  particular,  with  L  from 
(65)  the  symmetry  Is  confirmed  and  thus 

L  -  L*(f.*TL*)  1  =  (l.*1)*  .  (121 ) 

There  can  be  no  other  matrix  L  satisfying  the?  condition  "m"  because  the 
pseudo i nverse  is  unique. 

In  considering  the-  identities  (56)  anci  (59),  i.e., 

T  T 

a*'  L*L*  ,  a '  -  L  f.  , 

with  the  aid  of  (54a)  we  deduce  that 

a*  '  a  '  a*  '  a*  '  a  '  a*  ’  a  '  a  ' 

These  equations  follow  also  from  the  geometrical  setup,  and  can  be  obtained  upon 

T 

consulting  Table  1  [f  a'  should  be  t  tie  pseudoinverse  of  a*',  the  matrix  LL* 
would  have  to  be  symmetric,  i n  which  case  both  conditions  "£”  and  "m"  would  be 
satisfied  simultaneously  Rut  t h i s  can  occur  only  if  I ,-L ,  as  we  gather  from  the 
last  step  that  has  led  to  (121).  Accordingly,  we  conclude  that 


la*  ’  > 


(122) 


As  a  matter  of  interest,  we  now  turn  our  attention  to  the  matrices  T* .  T, 

Q,  and  A.  In  repeating  the  demonstration  which  has  resulted  in  (121),  but 

T 

with  T*  replacing  [.*  and  (Id)  replacing  (54a),  we  observe  that  T  and  T*  are 

T 

the  pseudoinverses  of  each  other  only  if  TT*  is  symmetric,  which,  in  turn, 
occurs  only  if  T*=T*.  Paralleling  (121),  we  thus  have 

T  T*(T*V)  1  -  ( T*T )  *  .  ( 123) 

where  the  first  equality  follows  from  (66).  The  matrix  Q  from  (95)  and  the 

matrix  A  from  (114)  yield  QA  I,  hereby  satisfying  the  first  three  criteria 

for  A  to  be  the  pseudo i nverse  of  Q.  However,  the  condition  "m"  can  be 

T 

satisfied  only  if  TT*  is  symmetric,  which  leads  to  T*-i*  as  above  and  thus  to 
tile  canonical  system.  The  last  assertion  is  due  to  the  fact  that  AT*^0  in 
(69)  entails  AL"  0,  (The  canonical  property  does  not  depend  on  T" ,  but  the 
latter  must  be  the  same  in  both  T*  and  T.)  In  this  system  one  has 

Q  =  TT*T  .  A  -  TT*^  ,  ( 124a, b) 

where  T*  and  T  are  linked  by  (123).  With  the  aid  of  (124a, b)  and  (108),  we 
finally  wr i te 

A  (}r  (Q<2T)  1  =  q'  <  125) 

In  terms  of  Chapter  4,  we  conclude  that  If  the  canonical  system  is  implied  in 
(48)  and  (49),  not  only  is  the  minimum-trace  criterion  satisfied,  but  tin1  four 
corresponding  matrices  in  these  equations  are  the  pseudo  inverses  of  each  other. 


8.  SUMMARY  AND  CONCLUSIONS 


The  subject  of  this  study  is  t  tie  parametric  least  squares  (L.S.)  method, 
where  the  adjustment  model  is  either  linear  oi  has  been  linearized  beforehand. 
In  adjustment  notations,  the  L.S.  setup  is  represented  by 

L  =  AX  V  , 


where  L.  V,  and  X  are  the  vectors  of  n  linearized  observations,  n  residuals,  and 
n  parametric  corrections  to  X°  (an  initial  set  of  parameters),  respectively. 

The  vector  L  is  formed  as  I.1'  L° ,  where  L^1  contains  the  actual  observations  and 
L°  contains  the  values  of  the  observables  consistent  with  X°.  An  additional 
vector  representing  n  adjusted  linearized  observations  is  symbolized  by  L', 
where 

L'  --  AX  . 


The  letter  A  denotes  the  design  matrix  of  dimensions  Inxu),  which  either  has  the 
full  column  rank  or  is  rank  deficient.  The  former  kind  has  been  treated  in 
(Hlaha.  1984],  while  the  latter  is  dealt  with  herein.  However,  the  basic  L.S. 
setup  and  its  geometrical  interpretation  are  the  same  in  both  the  full -rank  and 
the  rank  deficient  adjustment  models.  The  L.S.  criterion  in  either  model  reads 

vrpv  -  minimum  ,  PL1, 

where  P  and  L  are  respectively  the  weight  matrix  and  the  variance  covariance 
mutiix  of  observations,  both  of  which  are  pos i t i ve  def i n i te .  The  quantities  £ 
(and  thus  P),  A.  and  I,  are  known  a  priori 

Most  of  the  theory  concerned  with  the  development  of  a  geometrical  setup 
isomorphic  in  every  respect  to  i he  parametric  I. . S .  adjustment  can  be  found  in 
chapter  2.  in  this  task,  the  tensor  structure  has  proven  invaluable.  It  has 
brought  about  simple  correspondences  between  adjustment  quantities  and 
geometrical  objects,  as  ran  tie  gathered  upon  transcribing  the  above  three 
equations  in  tensor  notations: 

.  r  , r  ,  or  .r 

dx  A  du  *  dx 


Ar  du ’ " 
a 


1 1  x  g  1 1 ' 
s  r 


min  nun 


r  r 

Accordingly,  dx  corresponds  to  the  (linearized)  observations,  dx '  to  the 

adjusted  (linearized)  observations,  dx"r  to  the  error  estimate,,  (i.e.,  minus  the 
&  r 

residuals),  du'  to  the  parametric  corrections,  A  to  the  design  matrix,  g 

rt  a  SP 

to  the  weight  matrix  of  observations,  and  g  to  the  variance-covariance  matrix 

r  t 

of  observations.  Just  as  their  adjustment  counterparts,  the  tensors  g  (and 
r  r 

thus  g  ),  A  ,  and  dx  are  known  a  priori, 
sr  a 

r  r  r  cl 

The  geometrical  objects  whose  components  are  dx  ,  dx'  ,  dx"  ,  and  du '  are 

F 

referred  to  as  vectors  dx,  dx ' ,  dx" ,  and  du’,  respectively.  Although  A 

a 

cannot  itself  be  represented  graphically  by  a  single  object,  it  can  be  expressed 

via  components  of  orthonormal  vectors.  In  its  tensorial  formulation,  the  L.S. 

criterion  stipulates  that  the  length  of  the  vector  dx"  must  be  a  minimum.  Since 

the  vector  dx 1  is  restricted  to  an  implied  model  surface,  it  follows  that  dx"  is 

orthogonal  to  this  surface.  Crucial  to  the  geometrical  development  of  both  the 

f 

full  rank  and  the  rank  deficient  adjustment  models  is  the  property  whereby 
transforms  the  components  of  vectors  lying  in  the  model  surface  from  one 

p 

coordinate  system  to  another.  Accordingly,  the  above  relation  for  dx ' 
indicates  that  the  vector  denoted  du'  is  identical  to  dx ' . 

The  mere  t ranscr iption  of  the  basic  L.S.  setup  in  tensor  notations  suggests 
an  alternative  to  the  standard  algebraic  treatment  of  the  parametric  adjustment. 
The  approach  undertaken  herein  uses  geometry  with  tensor  structure  to  express 
all  the  adjustment  quantities  in  terms  of  orthonormal  vectors.  Through  this 
isomorphism,  the  observational  vector  dx  lying  in  an  n  dimensional  observational 
space  is  projected  onto  a  u'  dimensional  model  surface  as  dx'=du'.  The 


observational  space  is  spanned  by  n  orthonormal  vectors  t,  j, 


,  v . 


while  the  model  surface  embedded  in  this  space  is  spanned  by  u'  orthonormal 
vectors  d,  j.  ...  In  the  rank  deficient  problems,  where  the  rank  of  the  design 
matrix  Is  u'  and  the  rank  deficit  Is  u"  :u  u’,  the  model  surface  is  also  embedded 

in  a  u  -dimensional  parametric  space  spanned  by  u  orthonormal  vectors  d,  j . 

t.  ..  and  is  thus  an  intersection  of  the  observational  and  the  parametric 
spaces .  In  the  full -rank  problems,  where  u=u',  the  parametric  space  and  the 

F 

model  surface  coincide  In  both  cases  the  cont ravar 1  ant  components  dx '  , 

t  1.2,  .n.  and  the  cont ravar 1  ant  components  du'*.  a  1.2 . u,  are  related 


through  the  design  tensor  A  .  The  latter'  Is  shown  to  be  expressible  by  the 

a 

observat iona 1  space  rent ravar i ant  components  and  the  parametric  space  covariant 


(omporients  of  the  orthonormal  vectors  C,  j, 


spanning  the  model  surf  are. 


.  '  ,N  >  ,V..- 

*  •/  •.*  -  ’  -O  O  -  -  -  • 


The  isomorphic  geometrical  setup  reveals  that  all  the  adjustment  matrices, 
i.e.,  the  design  matrix,  the  variance  covariance  matrices  (of  observations, 
adjusted  observations,  residuals,  and  parameters),  and  the  corresponding  weight 
matrices,  can  be  expressed  as  a  product  of  two  constituent  matrices  each.  This 
outcome  is  further  qualified  as  follows. 

(a)  All  constituent  matrices  are  written  in  terms  of  orthonormal  vectors,  the 
elementary  geometrical  objects; 

( b >  These  vectors  are  the  same  In  either  matrix  of  the  constituent  pair,  only 
the  type  of  their  components  may  differ;  and 

\ c )  The  set  t,  j,  ...  spanning  the  model  surface  is  common  to  all  constituent 
matrices  except  those  pertaining  to  the  residuals  (and,  in  the  rank- 
deficient  context,  also  to  the  minimal  constraints  if  the  latter  are  used). 

The  geometrical  development  yields  simple  expressions  for  the  (singular) 
weight  matrices  of  adjusted  observations  and  residuals,  not  derived  in  standard 
adjustment  literature.  In  the  case  of  rank  deficient  adjustment,  it  confirms 
the  familiar  outcome  that  the  unique  variance  covariance  matrix  of  parameters 
which  has  the  minimum  trace  is  the  pseudoinverse  of  the  (singular)  matrix  of 
normal  equations.  At  the  same  time,  the  minimum -trace  criterion  results  in  the 
unique  parametric  solution  which  has  the  min  mum  norm.  By  comparison,  thr; 
minimum  norm  criterion  alone  leads  to  a  new  family  of  "data -induced”  inverses, 
each  of  which  produces  the  same  unique  solution  as  above,  not  merely  the  same 
minimum  norm  However,  since  each  such  inverse  constitutes  a  variance- 
covariance  matrix  at  parameters,  and  since  a  unique  parametric  solution  with  a 
non  unique  variance  covariance  matrix  has  little  practical  value,  the  minimum- 
trace  approach  is  preferred  to  the  minimum  norm  approach. 

From  the  theoretical  standpoint,  both  the  minimum -trace  and  the  minimum- 
norm  resolutions  are  merely  special  cases  of  the  general  resolution,  where  the 
solution  vector  as  well  as  Its  variance  covariance  matrix  are  non  unique.  The 
general  resolution  has  been  analyzed  in  three  distinct  formulations  presented  in 
chapters  3  5,  all  of  which  have  been  confirmed  in  Chapter  6  to  give  identical 
results  This  outcome  is  summarized  below  using  the  familiar  matrix  symbolism. 
However,  the  transcription  of  tensor  relations  into  matrix  relations  is  intended 
to  preserve  the  letter  symbols  g’ven  to  tensor  quantities,  rather  than  to  change 
them  to  standard  adjustment  symbols  such  as  those  seen  in  the  beginning 

b  ? 


-A  -" 


paragraph.  The  tensor  Indices  are  simply  dropped,  and,  in  the  case  of  a  purely 

rovariant  tensor,  the  original  letter  symbol  is  attributed  Thus,  for 

r 

example,  the  tensor  components  dx  are  grouped  in  the  adjustment  (column)  vector 
dx  Although  the  symbol  dx  has  been  used  earlier  to  Identify  a  geometrical 
object,  its  role  is  clearly  discernible  from  the  context.  As  another  example, 
the  tensor  components  du,a  are  grouped  in  the  adjustment  vector  du ' ,  while  the 
components  du^,  where  du^=A^g^ ( dx 1 .  are  grouped  in  the  adjustment  vector 
du*',  where  du* '  -A^g*dx .  The  latter  is  sometimes  referred  to  as  the  right  hand 
side  of  normal  equations.  This  transcription  illustrates  the  close 
correspondence  between  tensor  contractions  and  matrix  multiplications. 

The  universal  space  formulation  of  Chapter  3  generates  the  augmented 
observation  equations  presented  in  (38)  by  joining  the  minim.il  constraint  matrix 
Q  to  the  design  matrix  A: 

dx  I  A  1  dx" 

'  -  !  du'  i  ! 

|  0  j  .  Q  j  l  0 

T  T  T 

The  augmented  matrix  (A  Q  ]  must  have  the  full  column  rank  as  stipulated  by 
(39b).  The  complete  weight  matrix  Is  written  as  dlag. (g* ,k* ) ,  where  g*  is  the 
original  weight  matrix  of  observations  and  k*  is  an  arbitrary  positive  definite 
weight  matrix  associated  with  the  minimal  constraints.  The  matrix  of  normal 
equations  in  this  formulation  is  a*,  which  is  positive  definite  in  contrast  to 
the  original  positive  semi  definite  matrix  a*’.  The  general  solution  du '  and 
its  variance  rovar inner  mati ix  a'  are  expressed  from  (41a,b)  as 

du  '  adu*  '  =  a ' du* '  , 

a  '  a  a  *  1  a  , 

where  n  (a*)  1  The  solution  du ’  adu*'  is  the  standard  outcome  of  a  full  rank 
model  represented  here  by  the  augmented  observation  equations.  However,  the 
variance  cov.ir  inroe  matt  ix  in  such  a  model  would  be  a,  which  should  be  modified 
as  indicated  in  order  tn  yield  'he  desired  positive  semi  definite  matrix  a ’ 

The  minimal  constraint  formulation  of  Chapter  4  also  uses  the  matrix  Q. 
but  proceeds  through  augmented  normal  equations  as  in  the  standard  adjustment 
with  (absolute)  constraints  These  normal  equations  are  depicted  in  (48),  and 
are  resolved  in  the  form 

».  A 


V  V  .'  V  / 


-1 


j  du  '  fa*' 

|_dw*j  j_Q  0 


[du* 


After  the  inversion,  the  variance  covariance  matrix  a’  occupies  the  location  of 
a*'.  As  lias  been  shown  in  (50a, b).  the  complete  solution  consists  of  du'=a'du*' 
confirming  the  previous  result,  and  of  dw*=0.  The  vector  dw*  corresponds  to  the 
Lagrange  multipliers  in  adjustment  calculus.  The  geometrical  interpretation  in 
Chapter  4  illustrates  why  they  must  be  zero. 


The  analytical  formulation  of  Chapter  5  circumvents  the  use  of  minimal 
constraints  in  any  capacity,  and  thus  also  the  use  of  Q.  Instead,  it  proceeds 
to  form  the  basic  matrices  L* ,  L.  T* ,  and  T,  containing  the  parametric-space 
components  of  the  orthonormal  vectors  £,  j,  ...  ,  t.  ...  The  geometrical 

interpretation  of  these  matrices  reveals  that  only  L*  and  L,  containing  the 

components  of  8 ,  j .  participate  in  the  resolution  of  du 1  and  a'.  On  the 

other  hand.  T*  and  f,  containing  the  components  of  t,  ...  ,  serve  in  the 
analysis  of  Q  in  view  of  Chapters  3  and  4.  The  simplest  expressions  for  du' 
and  a'  follow  from  the  geometrical  setup  as 


du '  a ' du*  ' 
T 

a’  =  LL  . 


A  complete  description  of  I,  is  offered  by  (78),  namely 

T  T  T  1  T  T 

i,  -  (  (  I  0  ]  ►  HR  )  <L*  '  )  ♦  f  -R  I  ]  AI,"  . 

With  the  exception  of  A!.",  all  the  matrices  on  the  right  hand  side  can  be 

computed  from  the  matrix  of  normal  equations  a*',  and  are  considered  fixed.  In 

T 

this  task,  a*'  is  partitioned  clockwise  into  N  ,  N  .  N  and  N  ,  where  the 

ii  1  w  Cj  Ct  1  6 

leading  submatrix  N  ^  of  dimensions  (u'*u')  can  always  be  assumed  positive 

definite,  whether  a  priori  or  upon  reordering  the  parameters.  The  matrices 
T  1 

II,*'  )  and  R  of  dimensions  Iii'xii j  and  (u'xu'j,  respectively,  can  then  be 

obtained  via  the  Choleskl  algorithm  as  explained  in  Section  5.1.  i.e.,  via 

L*'1,*'T  N  and  R  N  1 N  .  Finally,  the  matrix  H  of  dimensions  (uxu'j  is 
11  1113  r  t  t  1 

constructed  in  (76)  as  H  =  (  R  I)  ( I +  R  K) 


The  above  expressions  for  du ' .  a’,  and  L  reveal  that  the  properties  of  the 
resolut  ion  depend  entirely  on  the  u"*u'  elements  grouped  in  AI," .  If  this 
matrix  is  completely  arbitrary,  L  has  the  most  general  form  resulting  in  the 
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general  resolution  of  du '  and  a'.  Clearly,  a  non  unique  solution  du’  and  a  non 
unique  variance  covariance  matrix  a'  hold  mainly  theoretical  Interest.  If 
AI."  is  partially  restricted  by  (91').  the  solution  du 1  is  unique  and  has  the 
minimum  norm.  The  restriction  (91’)  can  be  written  explicitly  as 

.U"  ([.*’)  1  {  (  I  0  |  •  K  HT>  du* '  =  0  , 

or  can  be  further  developed  into  (92),  etc.,  all  of  which  are  data  dependent  due 
to  du*'.  However,  a’  is  still  non  unique  since  it  is  only  partially  restricted 
with  respect  to  its  general  counterpart.  Finally,  if  AI."  0,  both  du 1  and  a’ 
are  unique.  In  this  case  du'  is  the  minimum  norm  solution  identical  to  the  one 
above,  and  a'  is  Its  variance  covariance  matrix  of  the  smallest  possible  trace. 
The  three  cases  Just  described  have  been  derived  in  conjunction  with  no 
criterion,  with  the  minimum  norm  criterion,  and  with  the  minimum  trace 
criterion,  respectively.  As  has  been  suggested  earlier,  t hp  minimum -trace 
criterion  is  superior  to  the  minimum  norm  criterion,  and,  by  the  same  token,  to 
any  other  criteria  Even  if  some  of  them  produced  unique  du '  and  a',  the  norm 
of  du'  would  not  be  a  minimum,  or  the  trace  of  a'  would  not  he  a  minimum,  or 
both  The  analytical  formulation  has  revealed  another  advantage  of  the  minimum 
trace  criterion  over  any  other,  namely  that  this  criterion  results  in  the 
simplest  expressions  possible,  represented  by  AI,"  0. 

The  analysis  of  Chapter  5  can  be  extended  to  the  approaches  of  Chapters  3 
arid  4,  developed  with  the  aid  of  the  matrix  Q  This  goal  is  addressed  in 
Chapter  3.  where  (93’)  presents  Q  in  the  general  form 

1  T  T 

Q  TIT")  (  H  A L " L  *  )  . 

The  matrices  H  and  Af,"  have  been  described  above,  the  matrix  I,*  of  dimensions 
( u»  u '  |  is  given  by  (37)  as  I.*  f  I  R)S.*'.  and  the  matrices  T  and  T"  of 
dimensions  (u"«u")  are  both  arbitrary,  subject  only  to  the  restriction  that  they 
must  tie  regular  The  geometrical  construction  of  Q  ensures  that  the  rank 
condition  (39b!  Is  satisfied.  The  properties  of  the  resolution  are  determined 
by  in  tlie  manner  of  the  preceding  paragraph.  Thus,  for  example,  the 

minimum  trace  criterion  corresponds  to  AI,"  0  This  stipulation  is  equivalent 

T 

to  4Q  0.  representing  a  special  rase  of  the  rank  condition  (39l>)  Again,  the 
matrix  Q  with  ,\t,"  n  is  the  simplest  of  its  kind.  It  is  usually  easy  to 
obtain  in  practice  from  the  structure  of  tin-  adjustment  model,  without  the  need 
f  or  an  exp  licit  f  or  mil  1  a  . 
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The  foregoing  has  illustrated  the  theoretical  benefits  offered  by  the 

analytical  formulation  of  Chapter  5  However,  this  formulation  holds  also  an 

economical  edge  over  the  other  two  In  particular,  the  analytical  approach 

calls  for  an  inversion  of  one  matrix  of  dimensions  (u'*u')  in  the  computation  of 
T  1 

( i.  * '  )  and  R,  and  one  matrix  of  dimensions  (u"*u“)  in  the  computation  of  H. 

Since  both  matrices  to  be  Inverted  are  positive  definite,  the  Choleski  algorithm 

T 

is  well  suited  for  this  task.  Although  the  matrix  I,*'  in  itself  could  be 

regarded  as  non  unique,  Section  71  shows  that  such  a  variability  is 

inconsequential  because  the  adjustment  results  for  du '  and  a'  contain  only  the 

T 

inverse  of  the  product  I.*'l.*'  .  which  is  unique  and  known.  By  comparison,  the 
use  of  augmented  observation  equations  in  Chapter  3  requires  an  Inversion  of  the 
positive  definite  matrix  a*  of  dimensions  (u*u),  where  u=u'+u".  Finally,  the 
use  of  augmented  normal  equations  In  Chapter  4  requires  an  Inversion  of  a  matrix 
whose  dimensions  are  [ ( u * u" ) x ( u mi " ) J .  Another  drawback  of  this  standard 
procedure  is  that  the  matrix  to  he  inverted  fs  not  positive  definite. 

Although  du'  and  a'  are  in  general  non  unique,  the  vector  dx '  containing 
'In'  adjusted  (linearized)  observations  and  the  variance-covariance  matrix  g’  of 
these  quantities  are  unique,  expressed  by 

dx '  A du' 

T 

g  A  a  '  A 

These  results,  derived  by  geometrical  means  In  Chapter  2.  are  applicable  to  each 

of  the  three  formulations  of  Chapters  3  5  In  terms  of  Chapter  3,  the  same 

T 

positive  semi  definite  matrix  g '  is  obtained  also  .is  g'  AaA  The  positive 
semi  definite  weight  matrix  associated  with  dx '  follows  from  the  weight 
propagation  law  established  in  Chapter  2  as 

g*  g *  g  g* 

With  regard  to  adjusted  (linear  i zed )  functions  of  parameters,  I  he  pattern 
presented  above  in  conjunction  with  dx '  and  g '  applies  in  every  respect  ,  except 
that  dx  '  g',  arid  A  arc  attributed  the  symbol  ~.  This  outcome  represents,  in 

fa<  <  .  the  variance  covariame  propagation  law  known  from  adjustment  calculus 
i The  weight  matrix  g* '  for  mii  h  functions  could  not  be  computed  in  analogy  to 
g* '  her ause  g*  is  unknown  )  The  new  weight  propagation  law  applied  to  adjusted 


observations  could  be  useful  If  the  latter,  or  their  subset,  should  participate 
in  some  capacity  in  another  adjustment.  The  natural  and  nearly  effortless 
derivation  of  this  law  highlights  potential  benefits  of  an  Isomorphic  approach, 
even  though  the  disciplines  being  related  may  initially  seem  quite  disparate. 

Several  other  topics  related  to  geometry  with  tensor  structure  have  also 
been  addressed  in  this  study.  For  example,  Section  7.3  confirms  that  the  matrix 
a'  in  the  minimum  trace  approach  is  the  pseudoinverse  of  a*1.  Upon  substituting 
AI."  0  iri  L.  listed  earlier,  this  pseudo i nverse  is  expressed  by 

(a*  )'  {  f  I  0  ]T  <  H  R F  1  N  ^  j  {  [  I  0]  -  RHT1  . 

Such  an  algorithm  could  be  useful  not  only  for  its  clearcut  geometrical 
interpretation,  but  also  for  its  computational  efficiency.  As  has  been  already 
indicated,  the  pseudo  1 nverse  of  a  positive  semi  definite  matrix  of  dimensions 
[  (  u  '  -*  u "  )  x  {  u  '  -n "  )  ]  entails  here  only  one  inversion  of  a  positive  definite  matrix 
of  dimensions  (u’*u')  and  one  inversion  of  a  posi t i ve  def in i t e  matrix  of 
dimensions  (u"*u).  Although  two  positive  definite  matrices  of  dimensions 
( u ' * u 1  )  could  be  inverted  instead,  the  above  procedure  is  more  advantageous  when 
u’>u",  which  is  by  far  the  most  prevalent  situation  In  actual  rank  deficient 
adjustments . 

A  part  of  the  theory  developed  in  this  study  is  illustrated  with  the  aid  of 
a  simple  example  in  Appendix  1.  This  example  treats  the  general  adjustment 
resolution,  the  minimum  norm  resolution,  and  the  minimum  trace  resolution  in 
each  ot  the  three  formulations  presented  In  Chapters  3  5  Appendix  2  introduces 
a  commutative  diagram  corresponding  to  Table  1  In  Chapter  2,  which  offers  a 
visual  representation  of  the  operat ions  that  can  be  performed  and  the  relations 
th.it  tan  tie  obtained  via  the  tensor  version  of  adjustment  quantities.  Although 
the  computational  merits  of  the  Oholeskl  algorithm  are  well  documented,  a 
comprehensive  geometrical  interpretation  of  this  algorithm  has  been  lacking  To 
fill  this  void  Appendix  3  interprets  the  Choleski  algorithm  for  the  positive 


definite  as  well  as  the  positive  semi  definite  matrices  in  trims  of  m  t  ho not nin  I 
vector  eomponents  Finally,  Appendix  4  shows  how  the  tensor  structure,  wb i <  h 
has  been  the  i oi ners t one  of  the  present  study,  could  also  be  useful  in 
apple  at  ions  unrelated  to  adjustment  calculus,  such  as  the  transformation  of 

multiple  j  n t eg t a  I s 
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APPENDIX  1 


NUMERICAL  EXAMPLE 


To  illustrate  the  formulas  and  methods  summarized  in  the  last  chapter,  we 
present  a  simple  numerical  example,  where  the  dimensions  are  n=3,  u=3,  u'=2,  and 
u'  1.  Thus,  the  rank  of  the  (3x3)  matrix  A  is  two  and  its  rank  deficit  19  one. 
We  begin  by  listing  the  quantities  which  are  given,  namely  A  (the  design 
matrix),  g*  (the  weight  matrix  of  observations),  and  dx  (the  vector  of 
linearized  observations),  followed  by  a  few  quantities  computed  from  them  and 
considered  fixed.  Subsequently,  we  shall  proceed  with  the  resolution  of  du ' 

(the  parametric  corrections)  and  a'  (their  variance- covariance  matrix)  according 
to  tin'  three  formulations  analyzed  in  this  study.  The  analytical  formulation, 
which  is  the  most  useful  theoretically  and  computationally,  will  be  treated 
first.  The  universal  space  formulation  giving  rise  to  augmented  observation 
equations  will  be  treated  second.  And  the  minimal  constraint  formulation  giving 
rise  to  augmented  normal  equations,  which  is  the  least  advantageous  of  the 
three,  will  be  treated  last. 


The  given  quantities  are 
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The  Choleski  algorithm  has  given  L*'  and  (L*'  )  as  upper  triangular 


A1 . 1  Analytical  Formulation 


The  fundamental  matrix  L  Is  given  by 

I.  -  {  (  I  0  ]T  ♦  HR7  }  (f.*,T)  1  +  [  -  R 
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'pon  substituting  the  pertinent  fixed  quantities,  this  becomes 
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(ieneral  resolution.  We  now  choose  AL"  at  random  as 
AI."  2  f  1  2)  , 

which  leads  to 
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The  remaining  adjustment  quantities  of  Interest  then  follow  as 
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The  adjusted  observations  dx 1  and  their  variance  covariance  matrix  g'  are 
Independent  of  Ah",  and  thus  of  the  resolution  characteristics,  as  is  verified 
below. 

Minimum  norm  resolution.  In  this  case  AL"  must  fulfill  the  following 
partial  restriction  linked  to  the  data  through  du* ' : 

M."  (!.*')  1  {  [  I  0  ]  -  RHT  }du*’  -  0  . 

With  the  aid  of  the  fixed  quantities,  this  becomes 

Al.  ”  (  2  1  | T  0  . 

One  such  partially  resti icted  choice  is 
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resulting  in 
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1  he  remaining  adjustment  quantities  are  computed  as 
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T  r ( a  )  3  du '  du '  17.9  mini  mum 


This  type  of  a’,  referred  to  earlier  as  a  data  induced  inverse  of  a*’,  results 
in  t  he  minimum  norm  solution  flu'  The  values  of  fix'  and  g  -ire  roof  i  lined  to  he 
the  same  as  those  in  <A1.3a.b),  and  need  not  be  listed  again 

Minimum  finer  resolution  This  case  entails 


ami  thus 
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( A 1  7.i,li) 


Die  vector  du'  in  (A1.7b)  represents  the  minimum  norm  solution,  the  same  as  Ms 
count report  in  (A1.5b),  while  the  matrix  a'  in  ( A 1  ,7a)  has  the  minimum  trace 
The  values  of  d.\ '  and  g'  are  again  identical  to  t  hose  in  (A1  da.b) 

Minimal  constraint  matrix.  This  matrix,  denoted  here  as  y,  is  not  needed 
in  the  analytical  formulation,  but  is  presented  for  the  sake  of  the  other  two 
formulations  Although  a  matrix  Q  acceptable  for  the  general  resolution  could 
easily  be  found,  and  although  such  a  matrix  for  the  minimum  trace  resolution  is 
often  supplied  in  practice,  the  situation  with  regard  to  the  minimum  norm 
resolution  is  more  complex  in  that  y  does  not  depend  on  A  alone,  but  can  In¬ 
formed  only  after  dx  and  thereby  du* '  have  been  evaluated  The  general  formula 
giving  y  reads 
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The  regular-  hut  otherwise  arbitrary  matrices  T  and  T"  have  no  effect  on  du 
and  a  Here  t hey  are  chosen  as 


T  1  I"  2  9 


In  using  the  same  '!,  as  presented  in  (A1. 1,4.6),  we  obtain  the  following 
matrices  y  tor  t he  three  kinds  of  resolutions: 
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A1.2  Universal  Space  Formulation 


(ieneral  resolution  In  augmenting  the  design  matrix  A  by  the  minimal 

constraint  matrix  Q  from  (Al.ft).  we  create  an  augmented  matrix  of  observation 
T  T  T 

equations  I A  Q  ]  .  whose  rank  is  three  as  stipulated  by  the  rank  condition. 
As  the  weight  matrix  associated  with  Q,  we  choose  k*  1 .  (This  is  consistent 
with  the  above  choice  T1  .  but  k*  could  be  changed  without  affecting  Q  by 
virtue  of  the  arbitrariness  in  T"  )  The  augmented  observation  equations  in 
conjunction  with  the  complete  weight  matrix  diag.(g*,k*)  yield 
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In  using  this  matrix  a  in  the  expressions 

a  aa*'a  ,  du '  adu*'  ;  a'du*’ 

wc  obtain  the  results  Identical  to  ( A 1  2a. b)  in  the  analytical  formulation. 
Similarly,  the  results  for  dx '  and  g'  are  identical  to  those  listed  in 
i  %  l  3.1, b)  In  agreement  with  t  he  relation 
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Minimum  trace  resolution . 
T 

AQ  -0  hs  .t  special  case  of  the 


In  augmenting  A  by  Q  from  (A). 10),  we  have 
rank  condition.  The  above  weights  then  yield 
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The  outcome  for  a'  and  du '  is  now  identical  to  (A1.7a,b);  and  the  outcome  for 
dx'  and  g'  is  similarly  identical  to  (A1.3a,b).  It  can  thus  be  concluded  that 
in  each  kind  of  resolution,  the  results  for  du ’  and  a'  agree  perfectly  with 
those  found  in  the  analytical  formulation. 


A  1.3  Minimal  Constraint  Formulation 


General  resolution.  The  solution  of  augmented  normal  equations  with  Q 
given  by  (A1.8)  is  computed  as 
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stage,  the  (3x3)  leading  submatrix  on  the  right  hand  side  is  confirmed 
from  ( A 1  2a).  In  carrying  out  the  indicated  multiplications,  we  obtain 
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In  analogy  to  the  preceding  paragraph,  a'  and  du '  are  confirmed  by  (A1.5a,b), 
and  dw*  0  is  again  seen  to  be  valid. 
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Here  dw*  o  is  .tgaiti  fulfilled,  while  a'  and  du'  agree  with  (A1.7a,b).  We  not  let 

ihai  t he  matrix  to  be  inverted  above,  although  regular,  is  not  positive 

definite  In  particular.  Its  leading  submatrix  of  dimensions  (.9x3)  is  positive 
semi  definite,  which  would  cause  the  regular  Choleskl  algorithm  to  break  down 
due  tu  a  division  by  zero  at  the  IpvoI  of  the  element  (3.4). 

This  .  deludes  the  comparisons  and  verifications  intended  to  illustrate  t tu 
consistency  among  the  three  formulations,  as  we  1 1  as  their  theoretical  and 
economical  ranking  The  inversions  we  have  witnessed  implicate  the  following 
mi*!  lies  lal  Two  positive  definite  (symmetric)  matrices  of  dimensions  ( Z x  2  ) 
and  (l-l)  i  ci  the  analytical  formulation;  (b)  One  positive  definite  (symmetric) 
mat i  ix  nf  dimensions  (a-  ')  i n  the  universal  spate  formulation,  and  It  )  One 
s ymme t i  1 1  matrix  of  dimensions  (  4  ■  4  1  ,  regular  but  not  positive  definite,  in  the 
minima!  mnstiiiinl  formulation  As  a  matter  of  interest  the  same  adjustment 

result  a  (in'!  listed  he-ie)  have  been  found  in  the  universal  space  and  the 
minimal  constraint  formulations  with  different  values  of  T  and  T  a f  f  ei  t  i ng 
0  bo’  no*  du  and  a  Finally  the  outcome  foj  d.\  and  g'  is  confirmed  to  be 

invar  laOle  not  only  with  regard  t  n  1  and  I  f'nt  also  to  I 


APPENDIX  2 


COMMUTATIVE  DIAGRAM 


The  tensors  defined  In  Table  1,  including  the  covariant  forms  of  the  first 
two  groups,  have  provided  the  necessary  tensor  relations  utilized  in  this  study. 
All  of  these  relations,  as  well  as  many  others  that  can  be  derived  with  the  aid 
of  Table  1,  are  summarized  visually  via  the  commutative  diagram  of  Fig.  2.  To  a 
certain  extent,  tnis  diagram  resembles  the  right  hand  side  of  the  diagram 


presented  in  Fig  2  of  (B|.  The  main  differences  stem  from  the  fact  that  the 
boxes’  representing  the  vector  components  du°  and  du  have  now  been  subdivided 

p 

into  two  parts  each,  and  that  the  extreme  right-hand  portion  of  the  diagram 
encompassing  the  components  dw^  and  dw  has  been  added. 


lust  as  fable  1.  the  diagram  of  Fig.  2  shows  the  partition  of  the 
underlying  universal  space  into  three  surfaces  combined  in  two  spaces.  The 
description  ot  the  diagram  can  be  made  in  a  close  analogy  to  the  specifications 
found  in  (H |.  In  particular,  the  vector  components  (marked  in  boxes)  symbolize 
at  the  same  time  the  spaces  or  surfaces  in  which  these  vectors  exist.  Thus,  in 
both  the  emit  ravar  iant.  and  the  covariant  versions,  the  boxes  representing  dx ' 
and  dx  '  should  he  Imagined  as  completely  filling  the  box  representing  dx.  A 
similar  statement  can  be  made  also  with  regard  to  the  boxes  representing  du', 
do'.  and  dn.  The  second  order  tensors  acting  as  linear  transformation  operators 
'io  designated  tty  arrows  The  heavier  lines  identify  the  quantities  which,  in 
t  to  corresponding  L.S,  setup,  are  considered  known  a  priori. 


The  description  of  the  diagram's  functioning  could  he  adopted  from  ( fl )  as 
well  The  arrows  with  dots  can  again  be  used  in  two  ways,  i.e.,  the  dots  can 
either  tie  considered  as  an  integral  part  of  the  arrow,  or  can  be  disregarded. 

And  when  expressing  one  quantity  in  terms  of  some  other(s),  we  again  start  at 
t. tie  desired  box  or  at  the  tip  of  the  desired  arrow  and  proceed  against  the 
iiret  r  ion  of  the  arrow(s)  along  a  chosen  (possibly  even  repetitive)  path,  noting 
i I  I  *he  ser  mid  order  tensors  encountered  during  t  ti  1  s  process  The  relation  is 
■  mpletod  when  a  selected  box  or  the  base  of  a  selected  ai  row  is  readied . 
kqu  1 1  c  ei  \  i  1 "a . b  )  represent  simple  app 1 1 ea  t  ions  of  these  two  rules. 


Hu-  inter  surface  contractions  (during  which  one  of  the  two  vertical  dashed 

r  <x 

lines  is  crossed)  result  again  in  a  zero  tensor,  such  as  in  A  du"  =0,  The 

r  s  ci  3  ^ 

four  vertical  arrows  g  '  ,  g  ,  a  h.  and  a.  are  not  part  of  such  contractions 

sr  j9a 

since  they  are  associated  with  the  surfaces  on  either  side  of  the  dashed  lines. 
Finally,  various  contractions  among  the  first  and  second-order  primed  tensors 
can  again  be  added  algebraically  to  their  doubly  primed  counterparts,  the  result 


being  the  corresponding  unprimed  tensor.  A  simple  example  of  this  kind  is 
r  r  r 

g'  dx ’  *g"  dx"  g  dx  ,  where  the  g’  and  g"  arrows  could  be  replaced  by  the 
sr  sr  sr  J 

g  arrows.  More  detail  as  well  as  examples  illustrating  the  above  rules  can  be 


Geometrical  commutative  diagram  for  the  rank-deficient  parametric  adjustment 


APPENDIX  3 


GEOMETRICAL  INTERPRETATION  OF  THE  CHOLESKI  ALGORITHM 


A3 . 1  Full -Rank  Case 


In  the  geometrical  interpretation  of  the  full  rank  adjustment,  such  as 

described  in  [BJ,  no  individual  components  of  the  orthonormal  vectors  are  known, 

but  certain  combinations  of  such  components  are  given  as  a  part  of  the  L.S. 

r  r  s 

setup.  These  combinations  correspond  to  the  tensors  dx  ,  g  and  thus  g  ,  and 
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A^  at  the  point  P,  presented  as 
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Except  for  the  index  L,  the  above  notations  are  the  same  as  those  utilized  in 
(Ft],  The  u’  dimensional  model  surface  is  endowed  with  the  coordinate  system 

symbolized  here  by  {u1},  L=l,2 . u'.  This  deviation  from  the  notations  in  [B] 

should  present  no  difficulty. 


In  the  full  rank  setup,  the  components  of  the  orthonormal  vectors  are  used 

as  geometrical  tools  in  formulating  tensor  equations.  In  this  role  they  take 

part  in  operat .ons  that  leave  no  room  for  completely  arbitrary  components,  as 

contrasted  to  the  rank-deficient  setup  where  entire  sets  of  such  components  can 

be  chosen  arbitrarily  without  conflicting  the  a  priori  information.  For 

s  r 

example,  t  tie  metric  tensor  of  the  model  surface,  formed  as  a  , "A^g  A  ,  is 

ML  M^ sr  L 

expressible  through  the  covariant  components  of  the  model  surface  orthonormal 
vectors  £,  j.  ...  Such  a  relationship  allows  one  to  compute  a  family  of  sets  of 

these  components,  each  set  reconfirming  the  correct  tensor  a  corresponding  to 

ML 

the  matrix  a*  of  normal  equations,  but  no  set  allowing  any  of  its  components  to 
be  changed  arbitral ily.  The  set  which  is  the  most  useful  for  the  subsequent 
inversion  of  a*  would  be  a  natural  choice  in  the  numerical  resolution  of  the 
adjustment  problem.  Clearly,  the  inversion  of  a*  can  also  proceed  by  purely 
algebraic  means,  where  the  computation  of  the  individual  components  of  £,  j.  ... 
is  bypassed. 


78 


Although  no  numerical  aspects  were;  considered  in  f B j .  it  is  instructive  to 
show  how  the  covariant  components  of  the  model  surface  orthonormal  vectors  could 
he  determined  in  the  full-rank  adjustment.  This  will  help  bring  into  focus  the 
ambiguity  associated  with  the  orthonormal  vectors  of  the  parametric  space  in  the 
rank  deficient  adjustment.  The  pertinent  tensor  relation  and  its  matrix 
formulation  read 


i  i  *  j  j 
ML  JMJL 


L*  ^ 


(A3. Ja,b) 


where  L*  is  regular  and  a*  is  positive  definite,  both  matrices  having  the 
dimensions  (u'xiij.  Since  a*  is  symmetric,  the  u'xu'  elements  of  L*  are 
determined  from  the  u'(u'*-l)/2  independent  elements  of  a*.  This  means  that 
u’(u’  l)/2  indeterminable  elements  of  L*  are  chosen  beforehand,  with  the  help  of 
which  the  other  u’(u'*-l)/2  elements  can  be  computed.  For  any  such  choice  there 
exists  a  matrix  L*  fulfilling  (A3. la).  All  possible  choices  give  rise  to  a 
family  of  matrices  L*  and,  accordingly,  to  a  family  of  sets  Sw ,  j  ,  ...  But 
once  a  set  is  computed,  no  components  can  be  changed  independently  of  the  others 
without  contradicting  the  fixed  values  in  a*. 

T 

The  greatest  number  of  elements  that  can  be  chosen  In  any  column  of  L*  is 

u'  1,  otherwise  the  corresponding  diagonal  entry  In  a*  would  not  in  general  be 

T 

accommodated  by  (A3. la).  Assuming  there  is  one  column  iri  L*  numbered  i  with 

u'  1  chosen  elements,  we  observe  that  no  other  column  can  have  u'  1  chosen 

elements.  (If,  for  example,  a  column  numbered  j  broke  this  rule,  the  ij  th 

entry  of  a*  would  not  in  general  be  accommodated.)  The  next  greatest  number  of 

chosen  elements  in  any  column  Is  u'-2,  l.e.,  there  are  two  computed  elements. 

If  this  column  is  numbered  j.  one  computed  element  accommodates  the  jj  th 

(diagonal)  entry  of  a*  and  the  oilier  accommodates  the  ij  th  entry.  Again,  only 
T 

one  column  in  L*  can  have  u1  2  chosen  elements.  The  next  greatest  number  of 
chosen  elements  in  any  column  is  u'  3,  etc.,  until  one  of  the  remaining  two 
columns  can  only  have  one  chosen  element  and  the  other  cannot  have  any. 


In  keeping  with  the  maximum  number  of  chosen  elements  in  each  instance,  we 

observe  that  there  are  u'  I.  u'  2.  u'  3 . 1,  and  0  chosen  elements 

T 

encompassing  gradually  t he  u'  columns  of  the  matrix  L*  .  The  order  of  these 
columns  as  well  as  the  order  of  the  chosen  elements  in  their  respective  columns 
are  arbitrary  Hut  since  the  sum  in  this  "maximum"  sequence  equals  u'(u'  1)/2, 


T 

there  cannot  be  fewer  chosen  elements  In  L*  either.  The  above  sequence  thus 

represents  the  exact  number  of  chosen  elements.  It  is  now  convenient  to  adopt 

T 

the  following  three  pronged  strategy  for  the  formation  of  the  matrix  L*  : 

1)  Assign  zero  values  to  all  chosen  elements;  2)  Arrange  the  columns  according 

to  the  descending  number  of  the  assigned  zeros  (the  first  column  has  u'-l  of 

them,  the  second  column  has  u'  2.  etc);  and  3)  Place  these  zeros  strictly  in 

T 

the  bottom  portion  of  each  column.  The  thus  constructed  matrix  L*  i9  upper 
triangular,  and  (A3. la)  reflects  the  standard  Choleskl  algorithm. 

Accordingly,  the  matrix  L*  is  lower-triangular,  which  means  that  no 

component  of  [4  ]  is  assigned  zero  value,  the  first  component  of  [j  1  is 

M  M 

assigned  zero  value,  the  first  two  covariant  components  of  the  next  orthonormal 

vector  are  assigned  zero  values,  etc.  This  is  how  far  we  need  to  go  toward  the 

determination  of  the  coordinate  system  {u^},  L^l,2 . u'.  It  is  clear  from  the 

foregoing  that  such  a  coordinate  system  is  compatible  with  the  known  metric 

tensor  aur  . 

ML 

With  regard  to  the  associated  metric  tensor  of  the  model  surface,  we  have 

LM  L  .M  .1  ,M 
a  K  4  4  +jj  +...; 

a  =  LLf  ,  L  -  [(4I,){  jL]  .  .  .  ]  .  ( A3 . 2a ,  b) 

Due  to  the  orthonormality  of  the  model -surface  vectors  4,  j .  it  holds: 

L*TI,  ==  I  ,  L  =  (I,*T)  .  ( A3 . 3a , b ) 

By  virtue  of  (A3. 3b).  equations  (A3. la)  and  (A3. 2a)  confirm  that 

a  =  (a*)  1  . 

T 

Since  the  matrix  L*  is  upper  triangular,  so  must  be  L.  This  means  that  the 
second  through  the  last  components  of  [4LJ  are  zeros,  the  third  through  the 
last  components  of  (j1']  are  zeros,  etc.  Consequently,  L  and  thus  also  the 
matrix  a  can  be  computed  more  efficiently  than  would  be  the  case  if  one  inverted 
a*  by  other  methods,  ignoring  its  positive  definite  structure. 

The  foregoing  development  has  illustrated  the  geometrical  meaning  of  the 
Choleski  algorithm  insofar  as  the  covariant  components  of  the  model  surface 
orthonormal  vectors  are  concerned.  Although  coordinates  need  not  have  been 
mentioned,  linking  coordinate  systems  to  the  above  procedure  offers  further 
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geometrical  Insight,  ami  can  even  prove  beneficial  in  solving  unrelated  problems 
as  will  be  exemplified  in  Appendix  4.  In  order  to  address  such  tasks,  we  make 
Lise  not  only  of  the  Implied  model  surface  coordinates  L- 1 , 2 ,  .  .  .  u  ’  ,  but 

introduce  another  set  of  model  surface  coordinates.  The  new  model  surface 

coordinates  are  symbolized  by  (vS,  I,- 1,2 . u1,  and  are  intended  to  describe 

the  model  surface  at  and  around  the  point  P.  As  a  crucial  step,  they  are 
stipulated  to  tie  Cartesian,  belonging  to  the  Cartesian  system  called  "local". 

The  latter  Is  defined  as  centered  at  P.  with  the  axes  directed  along  the  model 
surface  orthonormal  vectors  C  ,  j. 

We  now  postulate  a  very  special  configuration  of  the  u*’  coordinate  lines 
with  respect  to  the  v*'  coordinate  lines  (Cartesian  axes),  which  we  shall  call 
"canonical"'  First,  the  tangent  to  the  u*  coordinate  line  is  postulated  to 
coincide  with  the  v1  coordinate  line,  i.e.,  a  straight  line  along  t  This 
means  that  the  v2 ,  v3 ,  v4  ,  ...  ,  v°  coordinates,  i.e.,  the  Cartesian 

coordinates  along  directions  orthogonal  to  this  tangent,  are  unaffected  by 

differential  changes  in  the  u1  coordinate.  Second,  the  tangents  to  the  u1  and 

2  12 
u  coordinate  lines  are  postulated  to  span  the  same  plane  as  the  v  and  v 

coordinate  lines,  i.e.,  straight  lines  along  8  and  j,  respectively.  Therefore, 

the  v3,  v4 .  vU  coordinates,  i.e.,  the  Cartesian  coordinates  along 

directions  orthogonal  to  this  plane,  are  unaffected  by  differential  changes  in 

12  12  3 

the  u  and  u  coordinates.  Next,  the  tangents  to  the  u  .  u  ,  and  u  coordinate 

lines  are  postulated  to  span  the  same  (three  dimensional)  hyperplane  as  the 

1  2  3  4  u ' 

v  ,  v  .  and  v  coordinate  lines.  Consequent  1 y ,  the  v  ,  ...  v  coordinates 

12  3 

are  unaffected  by  differential  changes  in  the  u  ,  u  ,  and  iT  coordinates. 

1  2 

Continuing  In  this  manner,  we  finally  postulate  that  the  tangents  to  the  u  .  u  , 
ii3,  ...  ,  uU  1  coordinate  lines  span  the  same  (u'  1  dimensional)  hyperpiane  as 

the  v  .  v2,  V3 .  vU  1  coordinate  lines.  Thus  the  vU  coordinate 

(the  Cartesian  coordinate  along  the  direction  orthogonal  to  this  hyperplane)  is 

unaffected  by  differential  changes  in  the  u',  n2,  u3 .  u"  1  coordinates, 

and  is  affected  only  by  changes  in  the  uU  coordinate. 


in  retracing  the  steps  in  ttie  above  description,  we  deduce  that 


: 

11 

dv  -  du 

; 
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dv  /  du 
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0 

,  u ' 

.  .  dv  / du 

(A3. 4) 


which  is  associated  with  the  point  P  and  reflects  the  canonical  configuration 

there.  (As  a  matter  of  interest,  a  result  of  a  similar  form  would  be  obtained 

for  the  canonical  configuration  of  the  u^  coordinate  lines  with  respect  to  the 

vL'  coordinate  lines  even  if  the  latter  were  not  Cartesian.)  Since  the  only 

role  of  the  indices  (,  and  M  above  is  to  indicate  the  dimensionality  of  the  rows 

and  columns,  respectively,  such  indices  can  be  left  out  from  this  and  similar 

T 

expressions.  Just  as  L*  dealt  with  earlier,  the  (u'xu1 )  matrix  in  (A3. 4)  is 
upper  triangular.  In  fact,  in  the  next  step  we  demonstrate  that  these  two 
upper  triangular  matrices  are  identical. 


The  tensor 

transformation  law  applied  to  the 

model  surface 

orthonormal 

vectors  reads 

eM 

S  M 

(dv  /du  ) «s  . 

jM  =  ( dvS/duM) jg 

.  ... 

S  i  lice  £  ,  j  ,  .  .  . 

are  unit  vectors 

in  the  directions 

of  the  local 

Cartesian  axes 

we  have 

(«<J  [*S1 

^  (100...  ]T  . 

[Js]  -  fjS] 

=  (1  00  ... 

)T  .  ... 

Accordingly,  it 

follows  that 

.  .  .  -S 

M.T  .  T 

f[*MJ[JMJ  •  •  J  ^  [avS/duMjT  s  [dv/du]T 


Since  the  matrix  on  the  left-hand  side  is  L*.  It  is  indeed  proven  that 

fdv/dii)  -  I,*T  .  (A3. 5) 
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This  result  shows  that  by  choosing  the  u  1  (  n  '  i)/2  indeterminable  elements 
T 

In  L*  as  zeros  according  to  the  Choleski  algorithm,  one  has  effectively  chosen 

the  canonical  configuration  of  the  coordinate  lines  u'  with  respect  to  the  local 

Cartesian  axes  directed  along  the  vectors  6,  J,  .  ..  If  these  n '  ( u '  l)/2 

elements  were  chosen  in  any  other  way,  the  coordinate  lines  u*'  would  have  a 

general  configuration  with  respect  to  £,  J,  . ..  Clearly,  equation  (A3. 5) 

remains  valid  no  matter  the  choice  of  the  i nde term  1 nah 1 e  elements,  which  only 

T 

affects  the  composition  of  T*  and  with  it  the  aspect  of  the  implied  coordinate 

system  {u*}  There  is  an  infinite  number  of  such  choices  compatible  with  the 

T 

matrix  a*  Hut  just  as  the  Choleskl  choice  for  L*  Is  simple  and  appealing 
numerically,  the  corresponding  canonical  property  relating  the  directions  of  the 
i/  :  i ;  d  i  no  t  e  lines  to  t  he  model  surface  orthonormal  vectors  is  simple  amt 
appea i l ng  geome t r l ca  2  1  y 

We  now  present  the  formula  (A3, la)  from  a  different  angle,  based  on  the 
outcome  (A3  5)  The  tensor  transformation  law  applied  to  the  model  surface 
met  r  i  i  t  ensnr  reads 

.  ,  S  M ,  .  R  I. . 

*»M[  Mv  / 3 u  )  (  dv  /du  )  aSR  . 

Since  the  coordinates  {v1'}  are  Cartesian,  a„_.  in  matrix  notations  is  I  (the 

SK 

unit  matrix),  and  the  above  tensor  equation  in  matrix  notations  becomes 
a*  [  <v  3u)T[3v/3u]  , 
which  is  (A3  t.,i  anticipated. 

Due  to  (A3  3b)  in  conjunction  with  (A3. 5),  we  can  also  write 

f,  (  dv  mi  )  \  du  * v  j  ,  ( A3 . 6 ) 


which  Is  again  upper  triangular  as  has  been  noted  earlier.  We  can  now  confirm 
(A3. 2a)  from  t h<-  tensor  transformation  Jaw  applied  to  the  model  surface 
associated  nuerir  tensor: 

!.M  !  RMS  RS 

a  !  -a  *v  )  (Mi  *v  !  a 

!  RS 

Again  since  < v  ;  r  epr  esents  the  local  Cartesian  coordinate  system,  a  in 

matrix  notations  i  >■  1.  and  the  above  tensor  equation  in  matrix  notations  becomes 


But  in  considering  (A3. 6),  tills  is  seen  to  be  (A3. 2a).  We  have  thus  reviewed 
the  Choleski  algorithm,  from  the  decomposition  of  a*  into  triangular  matrices  to 
the  inverse  solution  for  a.  and  shown  at  every  step  what  it  entails  in  the 
geometrical  language,  both  in  terms  of  the  components  of  the  model  surface 
orthonormal  vectors  and  in  terms  of  the  implied  coordinate  system  (uL). 


A3 . 2  Rank- Deficient  Case 

Similar  to  the  previous  section,  the  known  combinations  of  the  orthonormal 

r  rs 

vector  components  represent ing  the  rank  deficient  L.S.  setup  are  dx  ,  g  and 
r 

thus  g  ,  and  A  .  These  notations  have  been  used  throughout  the  body  of  the 
sr  a 

present  study.  As  has  been  Indicated  eg.  in  Section  3.1,  the  necessary  metric 
tensor  a'  corresponds  to  a*’,  the  known  positive  semi  definite  matrix  of 
normal  equations  of  dimensions  (u*u)  and  rank  u1.  The  tensor  and  matrix 
formulations  of  this  entity  are 

V«  +  Va 


a*'  =  L*L< 


L*  [[«3)fJ/9]  ) 


where  the  dimensions  of  L*  are  (u*u').  At  this  juncture,  the  notations  and 
relations  formulated  in  Section  5.1.  especially  equations  (52a) -(59).  can  be 
adopted  as  they  stand. 

The  metric  tensor  of  the  parametric  space,  a„  ,  is  unavailable  from  the 

pa 

L.S.  setup  But  it  is  instructive  to  express  it  in  theory,  including  the 
corresponding  matrix  relations: 


a.  =  ft  ft  ♦  j  „  j 
0a  (3  a  J(9Ja 


f  f  ■  •  - 
P  a 


a*  (L*  T* | ( L*  T> 


(A3. 7) 


where  T*  is  transcribed  from  (52c)  as  T*-([t  j.  .  J.  We  can  now  imagine, 

P 

alongside  the  implied  parametric  space  coordinate  system  (u  ),  a=l,2 . u, 

a  local  Cartesian  system  (u01),  a^l.2,...,u,  whose  axes  point  in  the  directions 
of  the  parametric -space  orthonormal  vectors  ft ,  j ,  . . .  .  t ,  . . .  In  analogy  to 
the  derivation  that  has  led  to  (A3. 5),  we  obtain 


fMpHjp]  •  ftg]  )  (au^/auV  *  [chi/3u)t 
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a  f  ui  thus 


I  *U  >u  I  [  1.*  T*  1T  ( A3 .  8 ) 

T 

Although  the  known  a*'  allows  us  to  determine  L*  by  (57),  T*  and  thus  a* 

are  unknown  Accordingly,  we  have  only  the  first  u'  rows  of  [3u/du]  in 

ITT  T 

(At  8),  equaling  L*  ;  { L*  ’  I.*”  |,  where  the  submatrix  I,*1  is  upper  triangular 

by  virtue  ot  the  Choleskt  choice.  In  assuming  that  the  first  u1  coordinates  of 

the  system  (u  ).  a  1,2 . u  represent  a  set  of  implied  model  surface 

coordinates,  we  deduce  from  the  full  rank  analysis  that  the  first  u’  of  the 


u  n  1.2 . u  coordinate  lines  have  a  canonical  configuration  with  respect 

T  T 

£■  J.  But  since  in  general  T* '  *0  and  T* "  /upper  triangular  matrix, 


T  T  T 

where  T*  ( T * '  T*"  ].  the  complete  matrix  of  partial  derivatives  in  (A3. 8)  is 

not  upper  triangular.  Therefore,  on  the  whole  the  configuration  of  the  u° 
coordinate  lines  with  respect  to  the  local  Cartesian  system  in  the  rank 
deficient  case  is  not  canonical. 

T 

The  above  assertion  concerning  T*  can  be  elaborated  as  follows.  From  (79) 

or  (80)  It  transpires  that  the  matrix  T*  corresponding  to  the  minimum  trace 

T  1 

solution  has  the  form  H(T"  )  ,  where  H  is  given  by  (76)  and  T"  is  arbitrary  but 

regular  It  thus  follows  that 

T  - 1  TIT 

T*  '  (T" )  (  I  *  R  R)  R  , 

where  R  depends  on  the  matrix  of  normal  equations  a*' ,  and  is  given  by  (58)  as 
1  T 

NjjN  Accordingly,  T* ’  -0  could  hold  only  if  R  0,  which.  In  turn,  would 
require  that  N  O  Since  in  general  such  a  restriction  does  not  apply,  the 
above  conclusion  regarding  the  non  canonical  configuration  of  the  u”  coordinate 
lines  is  confirmed,  as  least  insofar  as  the  most  desirable  resolution  of  the 
rank  deficient  model  is  concerned 


The  quantity  of  crucial  importance  in  the  rank  deficient  adjustment  is  the 
necessary  associated  metric  tensor  a'”'',  corresponding  to  the  variance 
covariance  matrix  of  t  he  adjusted  parameters.  We  now  have 


where  I.  is  g  i  ven  i  n  (  .r>2h  ) 


i.  !  ( K.j^l 


o  s 


However.  I,  cannot  bo  computed 


from  L*  in  analogy  to  (A3. 3b).  due  to  a  more  complex  relation  expressed  by 
(55)  Since  L*  is  known,  the  entire  outcome  hinges  on  the  choice  of  the  "free" 
mat i ix  T*  Once  T*  is  chosen  under  the  necessary  assumption  that  [),*  T* J  is 
tegular,  a*  can  be  computed  by  (A3  ?)  and  a  cai.  be  computed  as  (a*)  *.  The 
matrices  L  and  T  then  follow  as  L^ah*  and  T^aT* 

The  c  tint ravar  iant  component s  of  all  the  parametric  space  orthonormal 
vectors  are  thus  seen  to  depend  on  the  choice  of  the  covariant  components  of 
t.  Each  such  choice  is  instrumental  in  determining  the  numerical  values  of 

the  solution  vector  tin’  and  its  variance  covariance  matrix  a'.  Conversely,  by 
stipulating  certain  desirable  properties  for  do',  a',  or  both,  one  can  find  what 
it  entails  in  terms  of  the  covariant  components  of  t  ,  .  .  .  grouped  in  the  matrix 

TV  As  is  recapitulated  in  the  Summary  and  Conclusions,  the  basic  resolution 
properties  can  be  expressed  through  the  u"*u'  free  elements  grouped  in  the 
matrix  AT".  The  values  of  T*  if  desired,  can  then  be  found  from  (64)  and  (69) 
in  Section  5.2. 


APPENDIX  4 


TRANSFORMATION  OF  MULTIPLE  INTEGRALS  IN  ANY  DIMENSIONS 

In  this  appendix  we  seek  to  Illustrate  how  the  canonical  configuration 
encountered  in  the  full  rank  case  of  Appendix  3  could  be  useful  in  problems 
unrelated  to  the  present  study  and.  indeed,  to  any  L.S.  adjustment.  For  the 
sake  of  an  easy  visualization  without  the  aid  of  figures  or  diagrams,  we  proceed 
via  a  three  dimensional  example.  However,  due  to  the  nature  of  the  coordinate 
systems  involved  this  example  can  be  effortlessly  extended  to  any  dimensions. 

«r  can  tie  redo,  ed  t  ••  f  wo  dimensions.  The  notations  adopted  here  are  those  of 
'he  full  i  irk  case  in  Appendix  3.  i.e..  the  local  Cartesian  coordinates  are 
symbolized  by  tv*  }  and  the  implied  coordinates,  now  called  curvilinear,  are 
symbolized  by  <  u1’  >  In  the  three  d 1  mens i ona 1  application  the  indices  range  as 
I.  1.2,3 

We  begin  by  ■  ons t r uc t i ng  a  differential  parallelepiped  whose  edges  follow 
1  2  3 

the  directions  of  i he  u  .  u“ .  and  u  coordinate  lines  at  the  point  P  described 

12  3  1 

by  the  curvilinear  coordinates  <u  ,u  ,u  }.  First,  we  envision  the  u  coordinate 

2  3 

line  through  I’,  along  which  the  coordinates  u  and  u  are  constant.  Within  a 

short  distance  from  P.  a  segment  of  this  line  Is  straight.  We  also  envision 

1  2  2  3 

another  u  coordinate  line,  along  which  the  coordinates  (u  *du  )  and  u  are 

2 

constant  Due  to  the  small  difference  in  the  u  coordinate,  the  second  line  is 
close  to  the  first,  and  within  a  small  neighborhood  of  P  the  two  straight  line 

segments  are  pti  >!lel  In  the  same  fashion,  we  envision  parallel  straight  line 

2  1 
segments  of  two  u  coordinate  lint's,  the  first  characterized  by  constant  u  and 

3  1  1  3 

u  coordinates,  arid  t  fie  second  character  i  zed  by  constant  ( u  'du  )  and  u 

coordinates  We  are  now  In  the  presence  of  a  differential  parallelogram 

associated  with  t  vectors  da  and  db  emanating  from  P,  da  being  the  straight 

line  segment  along  the  first  u'  coordinate  line  and  db  being  the  straight  line 

2 

segment  along  the  first  u  coordinate  line  (there  is  no  need  to  use  additional 

notations  for  the  other  two  straight  line  segments  completing  the 

parallelogram)  Proceeding  in  a  similar  manner,  we  complete  the  differential 

parallelepiped  associated  with  the  vectors  da.  db,  and  do  emanating  from  P. 

These  three  vectors  form  the  parallelepiped's  edges  at  P  and  follow  the 

1  2  3 

directions  of  the  u  ,  u  .  and  u  coordinate  lines,  respectively. 


In  the  curvilinear  coordinate  system  ( u  "  > ,  the  contravar i ant  components  of 
the  three  differential  vectors  da.  db.  and  dc  are  denoted  as  da^  ,  db^' ,  and  dc^ , 

while  in  the  local  (artesian  system  {v^}.  these  components  are  da^=da  ,  db^=db 

1,  L 
and  dc  dc  The  local  Cartesian  system,  centered  at  P,  is  defined  in  such  a 

^  L  -L 

way  that  the  mutual  configuration  of  the  u'  and  the  v  coordinate  lines  is 

canonical  Consistent  with  an  earlier  description,  this  means  that  the  v1 

cartesian  axis  coincides  with  the  tangent  to  the  u1  coordinate  line  at  P  (i.e., 

the  v4-  and  v3  coordinates  are  unaffected  by  differential  changes  in  the  u^ 

coordinate),  and  the  v1  and  v^  Cartesian  axes  span  the  same  plane  as  the 

tangents  to  the  u1  and  u^  coordinate  lines  at  this  point  (i.e.,  the  coordinate 

a  12 

v  is  unaffected  by  differential  changes  in  the  u  and  u  coordinates). 

If  desired,  the  above  definition  could  be  readily  extended  to  four  and 

4  ~3 

higher  dimensions  by  adding  v  ,  ...  behind  v  within  the  two  parenthetic 

statements  in  the  preceding  paragraph,  and  by  continuing  in  the  same  manner, 

12  3 

i  e  .  stipulating  that  the  v  .  v  ,  and  v  Cartesian  axes  span  the  same 

12  3 

hyperplane  as  the  tangents  to  the  u  .  u  .  and  u  coordinate  lines  (the 

4  12  3 

coordinates  v  ,  .  are  unaffected  by  differential  changes  in  the  u  ,  u  ,  and  u 

coordinates i .  etc.  The  differential  parallelepiped  would  then  be  extended  to 

higher  dimensions  as  well.  In  particular,  its  edges  at  P  would  be  formed  by  the 

1  2 

differential  vectors  da.  db ,  dc ,  dd,  ...  following  the  directions  of  the  u  ,  u  . 
3  4 

u  ,  u  .  coordinate  lines. 

In  the  genera]  ('artesian  coordinates  (v1'},  i.e..  not  only  in  the  local 

Cartesian  coordinates  (v^).  the  projection  of  da  on  the  first  Cartesian  axis  is 

1  2 
da  da  the  projection  of  db  on  the  second  Cartesian  axis  is  db  =db  .  and  the 

3  ^ 

projection  of  dc  on  the  third  Cartesian  axis  is  dc  ;:dc^ .  However,  the  advantage 

ot  the  local  Cartesian  system  becomes  apparent  upon  the  realization  that  the 

1  2 

absolute  value  of  the  product  da  db  equals  the  surface  of  the  paral lelogram 

associated  with  the  vectors  da  and  db ,  and  the  absolute  value  of  the  product 

1  2  3 

da  db  dc  equals  the  volume  (dV)  of  the  parallelepiped  under  consideration, 
associated  with  the  vectors  da.  db,  and  dc .  In  continuing  the  same  process 
without  the  need  for  abstract  generalizations  other  than  the  straightforward 
extension  of  volume"  to  higher  dimensions  (it  equals  the  "area"  in  a  given 
hyperplarie  times  the  "height"  orthogonal  to  it),  one  obtains  the  formula  giving 

the  volume  of  a  parallelepiped  in  higher  dimensions  as  the  absolute  value  of 

.  t  ..  2  .  3  4 

da  db  dc  dd  . 
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Since  the  tensor  transformat Ion  law  specifies  that 


,  l  .  ,-L  M  M 
da  -  ( dv  flu  )  da 


dbL  =  (flvL/fluM)dbM  , 


.-I.  ,  -L/a  M.  .  M 

dc  -  (flv  /flu  )  dc 


and  since,  by  construction,  the  contravar lant  components  of  da,  db,  and  dc  In 
curvilinear  coordinates  are 


(daM]  , 

{du1  0  0]T  . 

tdbM]  = 

2  T 

[0  du  0]1 

it  follows 

that 

da1 

-  (  flv1  /  flu1 )  du1  , 

db2  = 

-2  2  2 
(dv  /du  ) du 

Accordingly,  the  volume  element  at  P  becomes 


[dcM]  5  (0  0  du3] 

.-3  , --3 , .  3,  ,  3 

dc  =  (flv  /flu  ) du 


dV  =  |da1db2dc3|  =  j  ( flv1  / flu1 ) ( flv2/ flu2 ) ( flv3/ flu3 ) |  du1  du2du3  ,  (A4.1) 

where  du1'  are  considered  positive.  A  completely  analogous  formula  is  readily 
available  in  higher  dimensions  (or  in  two  dimensions). 


Upon  consulting  equation  (A3. 4)  reflecting  the  present  canonical 
configuration,  we  transcribe  (A4.1)  as 

dV  ! Det [ flv/ flu ] | du1 du2du3  ,  (A4.2a) 

where  "Det"  stands  for  "determinant”.  Furthermore,  due  to 

a*  -  ( dv/ flu  J3"  (flv/ flu ]  , 

listed  prior  to  (A3. 6),  we  have 

Det;  (a*)  (Det (Av/ flu]  }2  , 

where  a*  Is  the  matrix  notation  for  the  metric  tensor  at  P  characterizing  the 
curvilinear  coordinate  system  (u1’).  This  allows  (A4.2a)  to  be  written  also  is 

dV  f Det ( a* ) ] 1 '  2 du  'du^du3  .  !  A  1  .  1 

Just  as  (A4.1).  the  formulas  (A4.2a,b)  are  readily  adaptable  to  anv  d'me- 

The  foregoing  development  leads  directly  to  the  formula  f\<i  *  r  no  1  % 

of  multiple  integrals  from  rectangular  to  curvilinear  i.oonl  t  oat  »s 
Cartesian  coordinates  for  a  given  region  in  space  art  n:  *  dco-.t  <  • 
the  curvilinear  coordinates  are  still  symbolized  by  ( u 1 '  >  1 
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(A4.2b)  is  valid  as  it  stands  because  it  involves  exclusively  the  curvilinear 
coordinates.  But  the  above  relations  giving  a*  and  Det(a*)  also  remain  valid 
with  {vL}  replacing  {vL}  because  the  only  property  used  in  conjunction  with 
these  systems  has  been  their  Cartesian  nature.  Accordingly,  the  formula  (A4.2a) 
likewise  remains  valid  with  {v^}  replacing  {vL}.  This  deduction  makes  one 
appreciate  the  fact  that  although  (A4.2a)  was  derived  with  an  upper-triangular 
Jacobian  matrix  [dv/du]  ,  it  now  holds  with  a  general  Jacobian  matrix  [dv/du]. 

The  equivalent  relations  (A4.2a,b)  can  thus  be  written  in  conjunction  with 
a  general  Cartesian  system  {v^}  as 

1  o  o  i  /o  i  o  <> 

dV  =  |  Det  [dv/du]  |  du  du£du°  =  [Det(a*)J  auau  au°  .  (A4.3) 

This  formula  results  in  the  following  transformation  of  triple  integrals: 

|f(vL)dV  s  j f (vL ) dv*dv2dv3  -  f  f  (P(uL)  ]  [Det  (a*)  ]1//2du1du2du3  ,  (A4.4) 

V  V  U 

where  the  relations  vL=P(uL)  or  uL=F  1 ( vL ) .  L=l,2,3,  describe  the  transformation 
of  coordinates  which  maps  the  region  V  into  U.  Consistent  with  the  philosophy 
maintained  throughout  this  appendix,  equation  (A4.4)  is  applicable  also  to  the 
transformation  of  double  as  well  as  multiple  Integrals  in  any  dimensions. 
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